00000001:02000400:3.0F:1788612259.659265:0:2963:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_hostid 00000001:02000400:3.0:1788612279.263674:0:3182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788612281.834056:0:3242:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 426 MB/s 00000001:01000000:1.0F:1788612282.091562:0:3242:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 433 MB/s 00000001:01000000:2.0:1788612282.340931:0:3242:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2515 MB/s 00000020:02000000:2.0:1788612283.556987:0:3274:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_ge9089f3 00000400:02000000:1.0:1788612284.980454:0:3289:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.106@tcp [8/256/0/180] 00008000:02000000:2.0:1788612288.630359:0:3439:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788612343.018107:0:5253:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing load_modules_local 00000020:01000004:0.0F:1788612354.592205:0:5833:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788612354.592216:0:5833:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788612354.592372:0:5833:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000009eb20d3 00000080:02000400:0.0:1788612354.592386:0:5833:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788612354.601735:0:5833:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788612354.601750:0:5833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788612354.601895:0:5833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000005fa4a393) 00000020:00000080:2.0:1788612354.601918:0:5833:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788612354.624031:0:5833:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788612354.624519:0:5833:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788612354.646347:0:5833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788612354.646393:0:5833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788612354.646415:0:5833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788612354.646465:0:5833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788612354.646568:0:5833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788612354.647049:0:5833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788612354.647057:0:5833:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788612354.647068:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfc956d548af413fe 00000020:01000004:1.0:1788612354.647167:0:5833:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788612354.647173:0:5833:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788612354.647177:0:5833:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000009eb20d3 from MGS 00000020:01000004:1.0:1788612354.647182:0:5833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788612354.647198:0:5833:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000d352acad) 00000020:00000080:1.0:1788612354.647209:0:5833:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788612354.647386:0:5833:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000009eb20d3 from MGS, refs=2 00080000:01000000:1.0:1788612354.647392:0:5833:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788612354.647398:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfc956d548af4140c 00000100:00100000:1.0:1788612354.647557:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788612354.647719:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788612354.647725:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788612354.648355:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788612354.648361:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788612354.649414:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612354.649566:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788612354.649571:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788612354.650364:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788612354.650371:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788612354.650701:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788612354.650707:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788612354.651643:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612354.651647:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612354.651649:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612354.653142:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612354.653147:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612354.653150:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612354.654113:0:5833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788612354.659776:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788612354.903931:0:5833:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 5099 MB/s 00000001:01000000:0.0:1788612355.153945:0:5833:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3955 MB/s 00000001:01000000:2.0:1788612355.404016:0:5833:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 571 MB/s 00000001:01000000:2.0:1788612355.654609:0:5833:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 835 MB/s 00080000:10000000:2.0:1788612355.662157:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1788612355.677649:0:5833:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788612355.677665:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788612355.677668:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788612355.681969:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788612355.682082:0:5833:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788612355.682141:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788612355.682420:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788612355.682448:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788612355.682808:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612355.682995:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788612355.683002:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788612355.688892:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788612355.688936:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788612355.690751:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788612355.690763:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788612355.691583:0:5833:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788612355.691603:0:5833:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.106@tcp' 00000020:01000004:0.0:1788612355.691605:0:5833:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788612355.691653:0:5833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.106@tcp (typ=mgc) 00000020:00000080:0.0:1788612355.691674:0:5833:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.106@tcp (00000000b08cedf1) 00000020:00000080:0.0:1788612355.691701:0:5833:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788612355.691878:0:5833:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009aca37c4@MGC192.168.202.106@tcp: add connection 192.168.202.106@tcp at head 00010000:00010000:0.0:1788612355.692030:0:5833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.106@tcp-0 is initialized 00000040:01000000:0.0:1788612355.692036:0:5833:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788612355.693745:0:5848:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788612355.694245:0:5849:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788612355.694301:0:5833:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.106@tcp (uuid 22c69a0a-d366-4936-9310-01935a424f88) 00000020:00000080:3.0:1788612355.694321:0:5833:0:(genops.c:1385:class_connect()) connect: client 22c69a0a-d366-4936-9310-01935a424f88, cookie 0xfc956d548af4141a 00000100:00080000:3.0:1788612355.694333:0:5833:0:(import.c:545:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788612355.694339:0:5833:0:(import.c:665:import_select_connection()) MGC192.168.202.106@tcp: import 000000009aca37c4 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1788612355.694380:0:5833:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000aa0dc32f x1875495914307712/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612355.694406:0:5833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 22c69a0a-d366-4936-9310-01935a424f88->MGS 00000020:01000004:3.0:1788612355.694422:0:5833:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788612355.694440:0:5833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788612355.694459:0:5833:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006b36e6ea) 00000020:00000080:3.0:1788612355.694481:0:5833:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788612355.695457:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa0dc32f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:22c69a0a-d366-4936-9310-01935a424f88:3304:1875495914307712:0@lo:250: 00000100:00100000:1.0:1788612355.695558:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612355.695711:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914307712 00000100:00100000:1.0:1788612355.695719:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914307712 00000100:00100000:1.0:1788612355.695747:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612355.695754:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afe73c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1875495914307712:12345-0@lo:250: 00010000:00080000:1.0:1788612355.695777:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 22c69a0a-d366-4936-9310-01935a424f88@0@lo t0 exp 0000000000000000 cur 149 last 0 00010000:00010000:0.0:1788612355.696382:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788612355.696566:0:5844:0:(genops.c:1385:class_connect()) connect: client 22c69a0a-d366-4936-9310-01935a424f88, cookie 0xfc956d548af41428 00000100:00080000:1.0:1788612355.696756:0:5844:0:(import.c:65:import_set_state_nolock()) 00000000bb697bc0 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612355.697421:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afe73c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+5:3304:x1875495914307712:12345-0@lo:250: Request processed in 1664us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612355.697433:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612355.698397:0:3304:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788612355.698411:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.106@tcp: connect to target with instance 0 00000100:00080000:1.0:1788612355.698418:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788612355.698424:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788612355.698426:0:3304:0:(import.c:65:import_set_state_nolock()) 000000009aca37c4 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788612355.698430:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788612355.698447:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788612355.698452:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa0dc32f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:22c69a0a-d366-4936-9310-01935a424f88:3304:1875495914307712:0@lo:250: 00000100:00100000:3.0:1788612355.729903:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612355.730074:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788612355.730080:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788612355.733900:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788612355.733916:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788612355.737389:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788612355.737402:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788612355.738442:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612355.738715:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788612355.738721:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788612355.739578:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788612355.739591:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788612355.777408:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612355.777703:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788612355.777710:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788612355.780204:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788612355.780218:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788612355.780885:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612355.781045:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788612355.781050:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788612355.781586:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788612355.781593:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788612355.782230:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612355.782391:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788612355.782396:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788612355.783160:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788612355.783169:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788612355.783752:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612355.784055:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788612355.784060:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788612355.784632:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788612355.784638:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788612355.805370:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612355.805648:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788612355.805656:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788612355.807030:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788612355.807041:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788612355.808702:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788612355.808714:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788612355.810419:0:5833:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788612355.810443:0:5833:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788612355.810455:0:5833:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788612355.810635:0:5833:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788612355.810686:0:5833:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788612355.810691:0:5833:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788612355.810692:0:5833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788612355.810693:0:5833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612355.810694:0:5833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612355.810696:0:5833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612355.810697:0:5833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612355.810698:0:5833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788612355.810699:0:5833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788612355.810701:0:5833:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788612355.810702:0:5833:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788612355.810703:0:5833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612355.810704:0:5833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788612355.810707:0:5833:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788612355.810709:0:5833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788612355.810710:0:5833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788612355.810711:0:5833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612355.810712:0:5833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612355.810713:0:5833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612355.810714:0:5833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612355.810715:0:5833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788612355.810716:0:5833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788612355.810718:0:5833:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788612355.810719:0:5833:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788612355.810719:0:5833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612355.810720:0:5833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788612355.810755:0:5833:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788612355.810773:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000046b98549 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914307840:0@lo:253: 00000100:00100000:1.0:1788612355.811018:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612355.811109:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c687ed2c going to sleep for 11 seconds 00000100:00100000:0.0:1788612355.811202:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914307840 00000100:00100000:0.0:1788612355.811210:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914307840 00000100:00100000:0.0:1788612355.812885:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612355.812904:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3129f40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+5:5833:x1875495914307840:12345-0@lo:253: 20000000:01000000:0.0:1788612355.812966:0:5847:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788612355.812969:0:5847:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788612355.813888:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788612355.813984:0:5847:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788612355.814270:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788612355.815558:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788612355.816207:0:5847:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788612355.816212:0:5847:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788612355.816218:0:5847:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788612355.816221:0:5847:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788612355.816234:0:5847:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788612355.816461:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612355.817625:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788612355.817647:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788612355.817706:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788612355.817755:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788612355.817968:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788612355.818202:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788612355.818211:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788612355.818254:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788612355.818261:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788612355.818293:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788612355.818300:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788612355.818329:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788612355.818390:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788612355.818429:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788612355.818435:0:5847:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788612355.818447:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612355.818728:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788612355.818737:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788612355.818773:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788612355.818944:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788612355.819007:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788612355.819018:0:5847:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788612355.819089:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788612355.819097:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788612355.819136:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788612355.819172:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788612355.819206:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788612355.819216:0:5847:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788612355.819293:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788612355.819302:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788612355.819332:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788612355.819366:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788612355.819584:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788612355.819633:0:5847:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788612355.819641:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788612355.820282:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788612355.820625:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788612355.820647:0:5847:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.106@tcp for mdt 20000000:01000000:2.0:1788612355.820649:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:2.0:1788612355.820695:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788612355.820703:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788612355.820732:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788612355.820739:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:2.0:1788612355.820779:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788612355.821012:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788612355.821050:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788612355.821095:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788612355.821158:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788612355.821161:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788612355.821165:0:5847:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788612355.821177:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788612355.821179:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788612355.821207:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788612355.821209:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788612355.821612:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788612355.822086:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788612355.822127:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788612355.822175:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1788612355.822187:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788612355.822189:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788612355.822660:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788612355.823021:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788612355.823058:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788612355.823113:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1788612355.823125:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788612355.823128:0:5847:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788612355.823133:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788612355.823135:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788612355.823140:0:5847:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788612355.823146:0:5847:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788612355.823448:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788612355.823614:0:5847:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788612355.829232:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788612355.829356:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788612355.829430:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788612355.829451:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788612355.829470:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000248381db/0xfc956d548af4142f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612355.829486:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000248381db/0xfc956d548af4142f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612355.829509:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000248381db/0xfc956d548af4142f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612355.829515:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000248381db/0xfc956d548af4142f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612355.829522:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000248381db/0xfc956d548af4142f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612355.829528:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000248381db/0xfc956d548af4142f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612355.829533:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000248381db already unused, calling callback (000000008a979940) 00010000:00010000:2.0:1788612355.829537:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000248381db/0xfc956d548af4142f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612355.829544:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000248381db/0xfc956d548af4142f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612355.829556:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000248381db/0xfc956d548af4142f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612355.829563:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000248381db/0xfc956d548af4142f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612355.829569:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000248381db/0xfc956d548af4142f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788612355.829590:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788612356.141451:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3129f40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+5:5833:x1875495914307840:12345-0@lo:253: Request processed in 328547us (330425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612356.141480:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612356.141664:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000046b98549 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914307840:0@lo:253: 10000000:01000000:0.0:1788612356.141689:0:5833:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788612356.141692:0:5833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788612356.141694:0:5833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788612356.141695:0:5833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612356.141696:0:5833:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788612356.141698:0:5833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612356.141699:0:5833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612356.141700:0:5833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788612356.141702:0:5833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788612356.141703:0:5833:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788612356.141704:0:5833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612356.141706:0:5833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788612356.141723:0:5833:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000009eb20d3 from lustre-MDT0000 10000000:01000000:0.0:1788612356.141807:0:5833:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788612356.141810:0:5833:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788612356.141814:0:5833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff928e90d3b380 10000000:01000000:0.0:1788612356.141817:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788612356.141825:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff928e90d3b380 from 1 10000000:01000000:0.0:1788612356.141828:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788612356.141909:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 0000000094ae6915/0xfc956d548af41436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.141919:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 0000000094ae6915/0xfc956d548af41436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.141927:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 0000000094ae6915/0xfc956d548af41436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612356.141948:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914307968:0@lo:101: 00000100:00100000:0.0:1788612356.141997:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612356.142184:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914307968 00000100:00100000:2.0:1788612356.142191:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914307968 00000100:00100000:2.0:1788612356.142230:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612356.142237:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f3a562a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+5:5833:x1875495914307968:12345-0@lo:101: 00010000:00010000:2.0:1788612356.142249:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612356.142260:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000248381db/0xfc956d548af4143d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41436 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612356.142291:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000248381db/0xfc956d548af4143d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41436 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612356.142300:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000248381db/0xfc956d548af4143d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41436 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612356.142307:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000248381db, rc 0) 00000100:00100000:2.0:1788612356.142332:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f3a562a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+6:5833:x1875495914307968:12345-0@lo:101: Request processed in 95us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612356.142337:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788612356.142443:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4b019f3 going to sleep for 11 seconds 00000100:00100000:0.0:1788612356.142457:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914307968:0@lo:101: 00010000:00010000:0.0:1788612356.142468:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 0000000094ae6915/0xfc956d548af41436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4143d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.142475:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 0000000094ae6915/0xfc956d548af41436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4143d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612356.142514:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914308096:0@lo:501: 00000100:00100000:0.0:1788612356.142538:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612356.142555:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4b019f3 going to sleep for 11 seconds 00000100:00100000:2.0:1788612356.142685:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308096 00000100:00100000:2.0:1788612356.142689:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308096 00000100:00100000:2.0:1788612356.142719:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612356.142725:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000298a6df6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+6:5833:x1875495914308096:12345-0@lo:501: 00000100:00100000:2.0:1788612356.143087:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000298a6df6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+6:5833:x1875495914308096:12345-0@lo:501: Request processed in 361us (548us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788612356.143094:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612356.143336:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914308096:0@lo:501: 10000000:01000000:0.0:1788612356.143361:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788612356.143377:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 0000000094ae6915/0xfc956d548af41436 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4143d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.143385:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 0000000094ae6915/0xfc956d548af41436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4143d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612356.143393:0:5833:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff928e98e67000 10000000:01000000:0.0:1788612356.143397:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788612356.143401:0:5833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff928e98e67000 10000000:01000000:0.0:1788612356.143404:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788612356.143406:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff928e98e67000 from 1 10000000:01000000:0.0:1788612356.143414:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788612356.143433:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000bf1f7056/0xfc956d548af41444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.143439:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000bf1f7056/0xfc956d548af41444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.143446:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000bf1f7056/0xfc956d548af41444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612356.143458:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914308224:0@lo:101: 00000100:00100000:0.0:1788612356.143485:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612356.143590:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308224 00000100:00100000:3.0:1788612356.143595:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308224 00000100:00100000:3.0:1788612356.143622:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612356.143627:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb4f120a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+6:5833:x1875495914308224:12345-0@lo:101: 00010000:00010000:3.0:1788612356.143635:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612356.143645:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b446886/0xfc956d548af4144b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41444 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.143659:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b446886/0xfc956d548af4144b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41444 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.143695:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b446886/0xfc956d548af4144b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41444 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.143702:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b446886, rc 0) 00000100:00100000:3.0:1788612356.143914:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb4f120a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+7:5833:x1875495914308224:12345-0@lo:101: Request processed in 102us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612356.143922:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788612356.144131:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4b019f3 going to sleep for 11 seconds 00000100:00100000:0.0:1788612356.144144:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914308224:0@lo:101: 00010000:00010000:0.0:1788612356.144154:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000bf1f7056/0xfc956d548af41444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.144161:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000bf1f7056/0xfc956d548af41444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612356.144171:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788612356.144220:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000bf1f7056/0xfc956d548af41444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.144227:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000bf1f7056/0xfc956d548af41444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612356.144234:0:5833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788612356.144237:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788612356.144242:0:5833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff928e98e67000 10000000:01000000:0.0:1788612356.144249:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788612356.144252:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788612356.144254:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788612356.144267:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 000000009dee05e6/0xfc956d548af41452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.144283:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 000000009dee05e6/0xfc956d548af41452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.144290:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 000000009dee05e6/0xfc956d548af41452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612356.144301:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914308352:0@lo:101: 00000100:00100000:0.0:1788612356.144326:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612356.144350:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4b019f3 going to sleep for 11 seconds 00000100:00100000:1.0:1788612356.144454:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308352 00000100:00100000:1.0:1788612356.144459:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308352 00000100:00100000:1.0:1788612356.144491:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612356.144497:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067cb91b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+7:5833:x1875495914308352:12345-0@lo:101: 00010000:00010000:1.0:1788612356.144504:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612356.144513:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005be3ad6c/0xfc956d548af41459 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41452 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612356.144527:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005be3ad6c/0xfc956d548af41459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41452 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612356.144534:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005be3ad6c/0xfc956d548af41459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41452 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612356.144540:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005be3ad6c, rc 0) 00000100:00100000:1.0:1788612356.144580:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067cb91b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+8:5833:x1875495914308352:12345-0@lo:101: Request processed in 84us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612356.144586:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788612356.144806:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914308352:0@lo:101: 00010000:00010000:0.0:1788612356.144816:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 000000009dee05e6/0xfc956d548af41452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41459 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.144822:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 000000009dee05e6/0xfc956d548af41452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41459 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612356.144883:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914308480:0@lo:501: 00000100:00100000:0.0:1788612356.144906:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612356.144930:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4b019f3 going to sleep for 11 seconds 00000100:00100000:1.0:1788612356.144979:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308480 00000100:00100000:1.0:1788612356.144983:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308480 00000100:00100000:1.0:1788612356.145108:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612356.145117:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ecdfea3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+8:5833:x1875495914308480:12345-0@lo:501: 00000100:00100000:1.0:1788612356.145343:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ecdfea3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+9:5833:x1875495914308480:12345-0@lo:501: Request processed in 229us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612356.145485:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914308480:0@lo:501: 00000100:00100000:0.0:1788612356.145525:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914308608:0@lo:503: 00000100:00100000:0.0:1788612356.145559:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612356.145703:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4b019f3 going to sleep for 11 seconds 00000100:00100000:1.0:1788612356.145798:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612356.145820:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308608 00000100:00100000:1.0:1788612356.145824:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308608 00000100:00100000:3.0:1788612356.145904:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612356.145913:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdecadc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+9:5833:x1875495914308608:12345-0@lo:503: 00000100:00100000:3.0:1788612356.146512:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdecadc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+9:5833:x1875495914308608:12345-0@lo:503: Request processed in 599us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612356.146519:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788612356.146708:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914308608:0@lo:503: 00000100:00100000:3.0:1788612356.147394:0:5875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000098d69b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:5875:1875495914308736:0@lo:502: 00000100:00100000:3.0:1788612356.147442:0:5875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612356.147477:0:5875:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2e89702 going to sleep for 11 seconds 00000100:00100000:0.0:1788612356.147527:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308736 00000100:00100000:0.0:1788612356.147533:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308736 00000100:00100000:3.0:1788612356.147646:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788612356.147654:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000000069cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+9:5875:x1875495914308736:12345-0@lo:502: 00000100:00100000:3.0:1788612356.147964:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000000069cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+9:5875:x1875495914308736:12345-0@lo:502: Request processed in 310us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612356.147972:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612356.148197:0:5875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000098d69b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:5875:1875495914308736:0@lo:502: 00000020:01000000:2.0:1788612356.148225:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612356.148237:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612356.148239:0:5875:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788612356.148244:0:5875:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788612356.148247:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788612356.148267:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b71712d2) 00000020:00000080:2.0:1788612356.148354:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788612356.148362:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788612356.148428:0:5875:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788612356.148442:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfc956d548af41467 00000020:00000080:2.0:1788612356.148802:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788612356.148807:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612356.148811:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612356.148812:0:5875:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788612356.148815:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612356.148818:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612356.148819:0:5875:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788612356.148822:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788612356.148827:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a1b43abf) 00000020:00000080:2.0:1788612356.148915:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788612356.148921:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788612356.148923:0:5875:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788612356.148925:0:5875:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788612356.148931:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788612356.149232:0:5875:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000009eb20d3 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788612356.149244:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000477d1ad2) 00000020:00000080:2.0:1788612356.149252:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788612356.149368:0:5875:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788612356.149374:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfc956d548af4147c 00000020:00000080:2.0:1788612356.149463:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788612356.149470:0:5875:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788612356.149474:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xfc956d548af41483 00080000:01000000:2.0:1788612356.149478:0:5875:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788612356.149481:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfc956d548af4148a 00080000:10000000:2.0:1788612356.150105:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788612356.150266:0:5875:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788612356.154448:0:5875:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788612356.267326:0:5875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788612356.272213:0:5875:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788612356.276323:0:5875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788612356.276631:0:5875:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788612356.358502:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000006e685244) 00000020:00000080:1.0:1788612356.358533:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788612356.358594:0:5875:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788612356.358601:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfc956d548af41498 00000020:00000080:3.0:1788612356.364598:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788612356.366110:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788612356.457907:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788612356.516109:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788612356.592107:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788612356.645026:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788612356.680188:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788612356.720496:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xfc956d548af4149f 00010000:00010000:1.0:1788612356.720869:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788612356.721134:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788612356.721147:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612356.721153:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612356.721155:0:5875:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788612356.721158:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612356.721162:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612356.721164:0:5875:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788612356.721167:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788612356.721168:0:5875:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788612356.721171:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612356.721173:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612356.721174:0:5875:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788612356.721176:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612356.721180:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612356.721182:0:5875:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788612356.721186:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788612356.721221:0:5875:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788612356.721351:0:5875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7f198a4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:5875:1875495914308864:0@lo:502: 00000100:00100000:2.0:1788612356.721427:0:5875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612356.721476:0:5875:0:(client.c:2716:ptlrpc_set_wait()) set 00000000182a9a6f going to sleep for 11 seconds 00000100:00100000:1.0:1788612356.721661:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308864 00000100:00100000:1.0:1788612356.721678:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308864 00000100:00100000:1.0:1788612356.721758:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612356.721767:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007eda0af2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+9:5875:x1875495914308864:12345-0@lo:502: 00000100:00100000:1.0:1788612356.722152:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007eda0af2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+9:5875:x1875495914308864:12345-0@lo:502: Request processed in 386us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612356.722160:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612356.722291:0:5875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7f198a4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:5875:1875495914308864:0@lo:502: 00000020:01000000:2.0:1788612356.722317:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612356.722322:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612356.722323:0:5875:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788612356.722327:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788612356.722777:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788612356.722795:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788612356.722812:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 000000009dee05e6/0xfc956d548af41452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41459 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.722822:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 000000009dee05e6/0xfc956d548af41452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41459 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612356.722829:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff928e98e67000 from 1 10000000:01000000:0.0:1788612356.722832:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788612356.722882:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.722890:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.722897:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612356.722912:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914308992:0@lo:101: 00000100:00100000:0.0:1788612356.722945:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612356.723190:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7b1a826 going to sleep for 11 seconds 00000100:00100000:3.0:1788612356.723360:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914308992 00000100:00100000:3.0:1788612356.723367:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914308992 00000100:00100000:3.0:1788612356.723394:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788612356.723400:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e660b0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+9:5833:x1875495914308992:12345-0@lo:101: 00010000:00010000:3.0:1788612356.723417:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612356.723431:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000681b4879/0xfc956d548af414ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af414a6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.723451:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000681b4879/0xfc956d548af414ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af414a6 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.723461:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000681b4879/0xfc956d548af414ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af414a6 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.723469:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000681b4879, rc 0) 00000100:00100000:3.0:1788612356.723509:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e660b0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+10:5833:x1875495914308992:12345-0@lo:101: Request processed in 110us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612356.723515:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612356.723651:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914308992:0@lo:101: 00010000:00010000:0.0:1788612356.723675:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af414ad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.723684:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af414ad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612356.724781:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914309120:0@lo:256: 00000100:00100000:0.0:1788612356.724835:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612356.725125:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7b1a826 going to sleep for 11 seconds 00000100:00100000:2.0:1788612356.725255:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914309120 00000100:00100000:2.0:1788612356.725262:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914309120 00000100:00100000:3.0:1788612356.725445:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788612356.725454:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053e4ec19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+10:5833:x1875495914309120:12345-0@lo:256: 20000000:01000000:3.0:1788612356.725475:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788612356.725482:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788612356.725581:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053e4ec19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+10:5833:x1875495914309120:12345-0@lo:256: Request processed in 127us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612356.725587:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612356.725651:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914309120:0@lo:256: 10000000:01000000:0.0:1788612356.726815:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788612356.726862:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af414ad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.726874:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af414ad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612356.726883:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928e98e67000 from 1 10000000:01000000:0.0:1788612356.726886:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612356.726919:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.726926:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.726933:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612356.726964:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914309248:0@lo:101: 00000100:00100000:0.0:1788612356.727011:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612356.727297:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7b1a826 going to sleep for 11 seconds 00000100:00100000:1.0:1788612356.727417:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914309248 00000100:00100000:1.0:1788612356.727424:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914309248 00000100:00100000:1.0:1788612356.727461:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612356.727467:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005375a0a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+10:5833:x1875495914309248:12345-0@lo:101: 00010000:00010000:1.0:1788612356.727478:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612356.727493:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee005efe/0xfc956d548af414bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af414b4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612356.727515:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee005efe/0xfc956d548af414bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af414b4 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612356.727524:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee005efe/0xfc956d548af414bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af414b4 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612356.727533:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee005efe, rc 0) 00000100:00100000:1.0:1788612356.727661:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005375a0a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+11:5833:x1875495914309248:12345-0@lo:101: Request processed in 193us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612356.727686:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612356.727817:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914309248:0@lo:101: 00010000:00010000:0.0:1788612356.727830:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af414bb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.727864:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af414bb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612356.727924:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914309376:0@lo:501: 00000100:00100000:0.0:1788612356.727950:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612356.727967:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7b1a826 going to sleep for 11 seconds 00000100:00100000:1.0:1788612356.728022:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914309376 00000100:00100000:1.0:1788612356.728027:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914309376 00000100:00100000:1.0:1788612356.728057:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612356.728063:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db28f9f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+11:5833:x1875495914309376:12345-0@lo:501: 00000100:00100000:1.0:1788612356.733381:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db28f9f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+11:5833:x1875495914309376:12345-0@lo:501: Request processed in 5194us (5305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612356.733397:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788612356.733977:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914309376:0@lo:501: 00000100:00100000:0.0:1788612356.734030:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914309504:0@lo:503: 00000100:00100000:0.0:1788612356.734089:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612356.734138:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7b1a826 going to sleep for 11 seconds 00000100:00100000:2.0:1788612356.735477:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914309504 00000100:00100000:2.0:1788612356.735502:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914309504 00000100:00100000:0.0:1788612356.735691:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788612356.735699:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bd78760 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+11:5833:x1875495914309504:12345-0@lo:503: 00000040:00080000:0.0:1788612356.735749:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788612356.735823:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bd78760 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+11:5833:x1875495914309504:12345-0@lo:503: Request processed in 124us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612356.735830:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788612356.735948:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a24e2bc pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914309504:0@lo:503: 00000040:00080000:2.0:1788612356.737012:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788612356.737447:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788612356.737467:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612356.737525:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af414bb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.737537:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af414bb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612356.737593:0:5833:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788612356.737596:0:5833:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff928e98e67000 10000000:01000000:0.0:1788612356.737599:0:5833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff928e98e67000 10000000:01000000:0.0:1788612356.737603:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788612356.737609:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff928e98e67000 from 1 10000000:01000000:0.0:1788612356.737611:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788612356.737648:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 000000006931fb73/0xfc956d548af414c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.737657:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 000000006931fb73/0xfc956d548af414c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.737679:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 000000006931fb73/0xfc956d548af414c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612356.737709:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d873b306 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914309632:0@lo:101: 00000100:00100000:0.0:1788612356.737785:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612356.737868:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba59b1fa going to sleep for 11 seconds 00000100:00100000:3.0:1788612356.738009:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914309632 00000100:00100000:3.0:1788612356.738016:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914309632 00000100:00100000:3.0:1788612356.738062:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788612356.738070:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017c27224 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+11:5833:x1875495914309632:12345-0@lo:101: 00010000:00010000:3.0:1788612356.738084:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612356.738097:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005bd70203/0xfc956d548af414c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af414c2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.738151:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005bd70203/0xfc956d548af414c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af414c2 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.738164:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005bd70203/0xfc956d548af414c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af414c2 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.738173:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005bd70203, rc 0) 00000100:00100000:3.0:1788612356.738220:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017c27224 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:5833:x1875495914309632:12345-0@lo:101: Request processed in 151us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612356.738226:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612356.739036:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d873b306 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914309632:0@lo:101: 00010000:00010000:0.0:1788612356.739056:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 000000006931fb73/0xfc956d548af414c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af414c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.739065:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 000000006931fb73/0xfc956d548af414c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af414c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612356.739209:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d873b306 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914309760:0@lo:501: 00000100:00100000:0.0:1788612356.739250:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612356.739463:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba59b1fa going to sleep for 11 seconds 00000100:00100000:1.0:1788612356.739510:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914309760 00000100:00100000:1.0:1788612356.739516:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914309760 00000100:00100000:1.0:1788612356.739649:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788612356.739657:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065d0d990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:5833:x1875495914309760:12345-0@lo:501: 00000100:00100000:0.0:1788612356.745354:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065d0d990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:5833:x1875495914309760:12345-0@lo:501: Request processed in 5687us (6093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612356.745370:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788612356.747073:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d873b306 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914309760:0@lo:501: 00000100:00100000:3.0:1788612356.747337:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e82ecac2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914309888:0@lo:503: 00000100:00100000:3.0:1788612356.747415:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612356.747497:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d8418978 going to sleep for 11 seconds 00000100:00100000:1.0:1788612356.748384:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914309888 00000100:00100000:1.0:1788612356.748394:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914309888 00000100:00100000:1.0:1788612356.748502:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788612356.748510:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000453d373f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:5833:x1875495914309888:12345-0@lo:503: 00000100:00100000:1.0:1788612356.748925:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000453d373f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:5833:x1875495914309888:12345-0@lo:503: Request processed in 415us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612356.748933:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788612356.749038:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e82ecac2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914309888:0@lo:503: 00000100:00100000:0.0:1788612356.751975:0:5880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff7b78df pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:5880:1875495914310016:0@lo:502: 00000100:00100000:0.0:1788612356.752074:0:5880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612356.759700:0:5880:0:(client.c:2716:ptlrpc_set_wait()) set 0000000048a57da8 going to sleep for 11 seconds 00000100:00100000:3.0:1788612356.760454:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310016 00000100:00100000:3.0:1788612356.760466:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310016 00000100:00100000:3.0:1788612356.760529:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788612356.760537:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044bd83e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:5880:x1875495914310016:12345-0@lo:502: 00000100:00100000:3.0:1788612356.760944:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044bd83e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:5880:x1875495914310016:12345-0@lo:502: Request processed in 406us (8869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612356.764469:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788612356.764590:0:5880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff7b78df pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:5880:1875495914310016:0@lo:502: 00000020:01000004:3.0:1788612356.764664:0:5880:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788612356.764690:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000dde5640e) 00000020:00000080:3.0:1788612356.764710:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788612356.764813:0:5880:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000009eb20d3 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788612356.764818:0:5880:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000009eb20d3 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788612356.764826:0:5880:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000009eb20d3 4 00010000:00080000:3.0:1788612356.764871:0:5880:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004e4306e4@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:3.0:1788612356.767628:0:5880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788612356.767831:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788612356.767889:0:5880:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788612356.767903:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xfc956d548af414d7 00000100:00080000:3.0:1788612356.767914:0:5880:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788612356.767920:0:5880:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004e4306e4 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1788612356.772601:0:5880:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000078d8a2f6 x1875495914310144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612356.772633:0:5880:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788612356.773087:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000078d8a2f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875495914310144:0@lo:38: 00000100:00100000:0.0:1788612356.773161:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612356.773574:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310144 00000100:00100000:3.0:1788612356.773582:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310144 00000100:00100000:3.0:1788612356.773620:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612356.773627:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003013b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875495914310144:12345-0@lo:38: 00000100:00100000:3.0:1788612356.773705:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003013b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875495914310144:12345-0@lo:38: Request processed in 76us (544us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788612356.773712:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612356.775115:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788612356.775126:0:3304:0:(import.c:65:import_set_state_nolock()) 000000004e4306e4 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612356.775132:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788612356.775136:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000078d8a2f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875495914310144:0@lo:38: 00000100:00100000:3.0:1788612356.776075:0:5880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee13e3f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:5880:1875495914310272:0@lo:502: 00000100:00100000:3.0:1788612356.776146:0:5880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612356.776184:0:5880:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ad87d8e0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612356.776456:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310272 00000100:00100000:0.0:1788612356.776463:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310272 00000100:00100000:0.0:1788612356.776512:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788612356.776521:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3c6e038 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:5880:x1875495914310272:12345-0@lo:502: 00000100:00100000:0.0:1788612356.776753:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3c6e038 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:5880:x1875495914310272:12345-0@lo:502: Request processed in 233us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612356.776761:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788612356.777201:0:5880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee13e3f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:5880:1875495914310272:0@lo:502: 00000040:00080000:3.0:1788612356.777230:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788612356.777411:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788612356.777427:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788612356.777446:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 000000006931fb73/0xfc956d548af414c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af414c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612356.777456:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 000000006931fb73/0xfc956d548af414c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af414c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788612356.777506:0:5833:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788612356.777508:0:5833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788612356.777510:0:5833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612356.777511:0:5833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612356.777512:0:5833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612356.777514:0:5833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612356.777515:0:5833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788612356.777516:0:5833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788612356.777518:0:5833:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788612356.777519:0:5833:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788612356.777520:0:5833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612356.777521:0:5833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788612356.777525:0:5833:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788612356.777527:0:5833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788612356.777529:0:5833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788612356.777530:0:5833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612356.777531:0:5833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612356.777531:0:5833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612356.777533:0:5833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612356.777534:0:5833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788612356.777535:0:5833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788612356.777536:0:5833:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788612356.777537:0:5833:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788612356.777538:0:5833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612356.777539:0:5833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788612356.777553:0:5833:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788612356.777562:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ca3d23a pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914310400:0@lo:253: 00000100:00100000:0.0:1788612356.777598:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612356.777629:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8f3a4a0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612356.777684:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310400 00000100:00100000:1.0:1788612356.777690:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310400 00000100:00100000:1.0:1788612356.777783:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788612356.777790:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f951fdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:5833:x1875495914310400:12345-0@lo:253: 20000000:01000000:1.0:1788612356.777812:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788612356.777825:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788612356.826538:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788612356.826554:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788612356.826563:0:5868:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788612356.826570:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788612356.826592:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.826622:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000681b4879/0xfc956d548af414ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af414a6 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.826630:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.826685:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000681b4879/0xfc956d548af414ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af414a6 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.826703:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000681b4879/0xfc956d548af414ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af414a6 expref: 12 pid: 5847 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612356.826719:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee13e3f0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1875495914310528:0@lo:104: 00000100:00100000:3.0:1788612356.826788:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612356.826869:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2e89702 going to sleep for 11 seconds 00000100:00100000:3.0:1788612356.826915:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310528 00000100:00100000:3.0:1788612356.826922:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310528 00000100:00100000:3.0:1788612356.826976:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612356.826986:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000859ebb6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+3:5868:x1875495914310528:12345-0@lo:104: 00010000:00010000:3.0:1788612356.826999:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af414ad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.827068:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788612356.827076:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000859ebb6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+3:5868:x1875495914310528:12345-0@lo:104: Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612356.827084:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788612356.827116:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612356.827121:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af414ad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.827135:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b9a0f753 already unused, calling callback (0000000099cd8996) 10000000:00010000:3.0:1788612356.827139:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af414ad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.827147:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af414ad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612356.827154:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af414ad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612356.827160:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612356.827192:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af414ad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.827199:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612356.827221:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af414ad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.827228:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 00000000b9a0f753/0xfc956d548af414a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af414ad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.827254:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612356.827257:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612356.827260:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612356.827341:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082f2f6a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914310656:0@lo:103: 00000100:00100000:3.0:1788612356.827386:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612356.828142:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310656 00000100:00100000:3.0:1788612356.828149:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310656 00010000:00010000:3.0:1788612356.828171:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000681b4879/0xfc956d548af414ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af414a6 expref: 13 pid: 5847 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612356.828215:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612356.828222:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd41bd63 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+13:3306:x1875495914310656:12345-0@lo:103: 00010000:00010000:3.0:1788612356.828233:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612356.828237:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000681b4879/0xfc956d548af414ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af414a6 expref: 13 pid: 5847 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.828252:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000681b4879/0xfc956d548af414ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af414a6 expref: 13 pid: 5847 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.828324:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.828332:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788612356.828407:0:5837:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001838020s 00010000:00010000:3.0:1788612356.828412:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.828418:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.828424:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.828492:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.828497:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fc194ade already unused, calling callback (000000008a979940) 00010000:00010000:3.0:1788612356.828500:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.828514:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.828522:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.828532:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612356.828684:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd41bd63 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+13:3306:x1875495914310656:12345-0@lo:103: Request processed in 463us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612356.828692:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788612356.828739:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000681b4879/0xfc956d548af414ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af414a6 expref: 12 pid: 5847 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612356.828751:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee13e3f0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1875495914310528:0@lo:104: 00010000:00010000:3.0:1788612356.828768:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.828776:0:5868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.828782:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612356.828787:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fc194ade/0xfc956d548af414de lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612356.831756:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082f2f6a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914310656:0@lo:103: 00000100:00100000:0.0:1788612356.843644:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f951fdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+11:5833:x1875495914310400:12345-0@lo:253: Request processed in 65846us (66037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612356.843673:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788612356.843700:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ca3d23a pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:5833:1875495914310400:0@lo:253: 10000000:01000000:2.0:1788612356.843722:0:5833:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788612356.843726:0:5833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788612356.843728:0:5833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788612356.843730:0:5833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612356.843731:0:5833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612356.843732:0:5833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612356.843734:0:5833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612356.843735:0:5833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612356.843736:0:5833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788612356.843737:0:5833:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788612356.843739:0:5833:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788612356.843740:0:5833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612356.843741:0:5833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788612356.843755:0:5833:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788612356.851337:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788612356.852088:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788612356.852637:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788612356.853013:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788612356.853221:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788612356.853739:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788612356.855202:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788612356.855760:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788612356.856112:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788612356.857573:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788612356.858026:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788612356.858198:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788612356.923354:0:5833:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788612356.953461:0:5833:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788612356.953687:0:5885:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788612356.953691:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788612356.953832:0:5886:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788612356.958236:0:5833:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788612356.958575:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788612356.959525:0:5833:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788612356.959536:0:5833:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788612356.959743:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612356.960728:0:5833:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788612356.961590:0:5833:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788612356.961630:0:5833:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788612356.961998:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788612356.962208:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788612356.964172:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788612356.964471:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788612356.964610:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788612356.964785:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788612356.965108:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788612356.965256:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788612356.965532:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788612356.965690:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788612356.965823:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788612356.972561:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788612356.972721:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788612356.972937:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788612356.973065:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788612356.973213:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788612356.973385:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788612356.973538:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788612356.973880:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788612356.974035:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788612356.974187:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788612356.974369:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788612356.974509:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788612356.975353:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788612356.975530:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788612356.975716:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788612356.975886:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788612356.976342:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788612356.976552:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788612356.976719:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788612356.977533:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788612356.977750:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788612356.978078:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788612356.978225:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788612356.978566:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788612357.028236:0:5886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788612357.179289:0:5833:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788612357.179332:0:5833:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa37a01637988 00100000:10000000:3.0:1788612357.179344:0:5833:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788612357.182108:0:5833:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788612357.182125:0:5833:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788612357.182138:0:5833:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788612357.182166:0:5833:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788612357.243247:0:5886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788612357.243336:0:5886:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1788612357.243341:0:5886:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788612357.748235:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612358.764098:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612359.788142:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612360.821721:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788612361.456816:0:6129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1788612361.777200:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788612361.777208:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff928e98e67000 from 3 10000000:01000000:1.0:1788612361.777213:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788612361.777254:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 000000001a47117c/0xfc956d548af414e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612361.777267:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 000000001a47117c/0xfc956d548af414e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612361.777276:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 000000001a47117c/0xfc956d548af414e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612361.777299:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000902fffa6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914310784:0@lo:101: 00000100:00100000:1.0:1788612361.777366:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612361.777626:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ef8aba3 going to sleep for 11 seconds 00000100:00100000:0.0:1788612361.778090:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310784 00000100:00100000:0.0:1788612361.778109:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310784 00000100:00100000:0.0:1788612361.778198:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788612361.778208:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d529903b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+11:5849:x1875495914310784:12345-0@lo:101: 00010000:00010000:0.0:1788612361.778228:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612361.778254:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9a0f753/0xfc956d548af414ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af414e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612361.778287:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9a0f753/0xfc956d548af414ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af414e5 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612361.778314:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9a0f753/0xfc956d548af414ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af414e5 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612361.778325:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9a0f753, rc 0) 00000100:00100000:0.0:1788612361.778403:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d529903b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:5849:x1875495914310784:12345-0@lo:101: Request processed in 197us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612361.778410:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788612361.779960:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000902fffa6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914310784:0@lo:101: 00010000:00010000:1.0:1788612361.779989:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 000000001a47117c/0xfc956d548af414e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af414ec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612361.780000:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 000000001a47117c/0xfc956d548af414e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af414ec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612361.780079:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000902fffa6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914310912:0@lo:256: 00000100:00100000:1.0:1788612361.780141:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612361.780182:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ef8aba3 going to sleep for 11 seconds 00000100:00100000:0.0:1788612361.780370:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914310912 00000100:00100000:0.0:1788612361.780385:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914310912 00000100:00100000:0.0:1788612361.780468:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788612361.780478:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000780a20fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:5849:x1875495914310912:12345-0@lo:256: 20000000:01000000:0.0:1788612361.780507:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788612361.780532:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788612361.780536:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788612361.780679:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000780a20fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:5849:x1875495914310912:12345-0@lo:256: Request processed in 202us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612361.780688:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788612361.781382:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000902fffa6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914310912:0@lo:256: 10000000:01000000:1.0:1788612361.781450:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788612361.781460:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: 000000001a47117c/0xfc956d548af414e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af414ec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612361.781478:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: 000000001a47117c/0xfc956d548af414e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af414ec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612361.836404:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788612362.298990:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788612362.299004:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788612362.299007:0:8:0:(import.c:65:import_set_state_nolock()) 000000004e4306e4 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612362.299023:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004e4306e4 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1788612362.299050:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e112e305 x1875495914311168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612362.300225:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee13e3f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914311040:0@lo:400: 00000100:00100000:0.0:1788612362.300323:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612362.300667:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e112e305 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875495914311168:0@lo:38: 00000100:00100000:2.0:1788612362.300754:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612362.301140:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311040 00000100:00100000:3.0:1788612362.301150:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311040 00000100:00100000:3.0:1788612362.301202:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788612362.301415:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311168 00000100:00100000:0.0:1788612362.301420:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311168 00000100:00100000:0.0:1788612362.301460:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612362.301466:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7f198a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875495914311168:12345-0@lo:38: 00010000:00080000:0.0:1788612362.301495:0:5854:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:0.0:1788612362.301552:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xfc956d548af414f3 00000004:00100000:0.0:1788612362.301602:0:5854:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788612362.301695:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3370fef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:3307:x1875495914311040:12345-0@lo:400: 00000100:00100000:3.0:1788612362.301758:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3370fef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:3307:x1875495914311040:12345-0@lo:400: Request processed in 73us (1435us total) trans 0 rc 0/0 00000100:00080000:0.0:1788612362.301933:0:5854:0:(import.c:65:import_set_state_nolock()) 00000000fea71f4d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612362.301977:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7f198a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875495914311168:12345-0@lo:38: Request processed in 509us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612362.301984:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612362.302028:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee13e3f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914311040:0@lo:400: 00010000:00080000:0.0:1788612362.302069:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e112e305 x1875495914311168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788612362.302083:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788612362.302091:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788612362.302095:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788612362.302098:0:3304:0:(import.c:65:import_set_state_nolock()) 000000004e4306e4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788612362.302102:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e112e305 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875495914311168:0@lo:38: 00000100:00100000:3.0:1788612362.302381:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788612362.861799:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612363.886279:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612364.909606:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612365.933635:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788612366.124426:0:6331:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffdc68c220 20000000:00000080:1.0:1788612366.124444:0:6331:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff928eacc51800 uarg=0000000000000000 20000000:01000000:1.0:1788612366.124479:0:6331:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788612366.124486:0:6331:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788612366.124491:0:6331:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788612366.124823:0:6331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788612366.124967:0:6331:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788612366.129097:0:6331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612366.129363:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788612366.129420:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788612366.129474:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788612366.129493:0:6331:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788612366.129511:0:6331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612366.129530:0:6331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ee005efe/0xfc956d548af414bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af414b4 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612366.129538:0:6331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612366.129591:0:6331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ee005efe/0xfc956d548af414bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af414b4 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612366.129608:0:6331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ee005efe/0xfc956d548af414bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af414b4 expref: 11 pid: 5846 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612366.129634:0:6331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000902fffa6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6331:1875495914311296:0@lo:104: 00000100:00100000:1.0:1788612366.129786:0:6331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612366.129872:0:6331:0:(client.c:2716:ptlrpc_set_wait()) set 0000000065e4ccad going to sleep for 11 seconds 00000100:00100000:3.0:1788612366.129978:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311296 00000100:00100000:3.0:1788612366.129987:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311296 00000100:00100000:3.0:1788612366.130046:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612366.130056:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007694ab79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+3:6331:x1875495914311296:12345-0@lo:104: 00010000:00010000:3.0:1788612366.130069:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af414bb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130139:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788612366.130144:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007694ab79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+3:6331:x1875495914311296:12345-0@lo:104: Request processed in 91us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612366.130152:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788612366.130174:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612366.130179:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af414bb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130186:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000418232f7 already unused, calling callback (0000000099cd8996) 10000000:00010000:3.0:1788612366.130189:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af414bb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130197:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af414bb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612366.130203:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af414bb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612366.130209:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612366.130239:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af414bb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130246:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612366.130267:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af414bb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130274:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: 00000000418232f7/0xfc956d548af414b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af414bb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130290:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612366.130292:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612366.130293:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612366.130342:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c3ca359 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914311424:0@lo:103: 00000100:00100000:0.0:1788612366.130373:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612366.130432:0:6331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000902fffa6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6331:1875495914311296:0@lo:104: 00010000:00010000:0.0:1788612366.130448:0:6331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612366.130495:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311424 00000100:00100000:3.0:1788612366.130499:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311424 00010000:00010000:3.0:1788612366.130515:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ee005efe/0xfc956d548af414bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af414b4 expref: 12 pid: 5846 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612366.130545:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612366.130552:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e119577 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+12:3308:x1875495914311424:12345-0@lo:103: 00010000:00010000:3.0:1788612366.130563:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612366.130577:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ee005efe/0xfc956d548af414bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af414b4 expref: 12 pid: 5846 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130587:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ee005efe/0xfc956d548af414bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af414b4 expref: 12 pid: 5846 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130600:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ee005efe/0xfc956d548af414bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af414b4 expref: 12 pid: 5846 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130611:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130618:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130641:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130647:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130653:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130658:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130663:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000917e6c00 already unused, calling callback (000000008a979940) 00010000:00010000:3.0:1788612366.130773:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130782:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130800:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612366.130811:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612366.130867:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e119577 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+11:3308:x1875495914311424:12345-0@lo:103: Request processed in 316us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612366.130874:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612366.130900:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c3ca359 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914311424:0@lo:103: 00010000:00010000:0.0:1788612366.130954:0:6331:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612366.130961:0:6331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612366.130966:0:6331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000917e6c00/0xfc956d548af414fa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612366.956243:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612367.404066:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f15d41a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914311680:0@lo:400: 00000100:00100000:3.0:1788612367.404187:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612367.404261:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612367.404267:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c3ca359 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914311552:0@lo:400: 00000100:00100000:3.0:1788612367.404296:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612367.404331:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311680 00000100:00100000:3.0:1788612367.404341:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311680 00000100:00100000:3.0:1788612367.404393:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612367.404402:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5ba13ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914311680:12345-0@lo:400: 00000100:00100000:3.0:1788612367.404457:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5ba13ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914311680:12345-0@lo:400: Request processed in 56us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612367.404464:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612367.404517:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311552 00000100:00100000:3.0:1788612367.404522:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311552 00000100:00100000:3.0:1788612367.404550:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788612367.404570:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0602585 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+11:3306:x1875495914311552:12345-0@lo:400: 00000100:00100000:3.0:1788612367.404601:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0602585 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+11:3306:x1875495914311552:12345-0@lo:400: Request processed in 47us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612367.404608:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788612367.404661:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c3ca359 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914311552:0@lo:400: 00010000:00080000:3.0:1788612367.404673:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007f15d41a x1875495914311680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612367.404686:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f15d41a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914311680:0@lo:400: 00010000:00010000:0.0:1788612367.981411:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612369.005137:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612370.028020:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788612370.988055:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788612370.988062:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928e98e67000 from 1 10000000:01000000:3.0:1788612370.988067:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788612370.988109:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: 00000000fc194ade/0xfc956d548af41501 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612370.988122:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: 00000000fc194ade/0xfc956d548af41501 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612370.988140:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: 00000000fc194ade/0xfc956d548af41501 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612370.988164:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f15d41a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914311808:0@lo:101: 00000100:00100000:3.0:1788612370.988228:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612370.988271:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f965159b going to sleep for 11 seconds 00000100:00100000:2.0:1788612370.988362:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311808 00000100:00100000:2.0:1788612370.988370:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311808 00000100:00100000:2.0:1788612370.988416:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788612370.988423:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e66b859a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+11:5849:x1875495914311808:12345-0@lo:101: 00010000:00010000:2.0:1788612370.988448:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612370.988461:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa72662f/0xfc956d548af41508 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41501 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612370.988484:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa72662f/0xfc956d548af41508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41501 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612370.988493:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa72662f/0xfc956d548af41508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41501 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612370.988502:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa72662f, rc 0) 00000100:00100000:2.0:1788612370.988551:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e66b859a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:5849:x1875495914311808:12345-0@lo:101: Request processed in 128us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612370.988558:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788612370.988696:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f15d41a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914311808:0@lo:101: 00010000:00010000:3.0:1788612370.988709:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: 00000000fc194ade/0xfc956d548af41501 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41508 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612370.988717:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: 00000000fc194ade/0xfc956d548af41501 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41508 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612370.988766:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f15d41a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914311936:0@lo:501: 00000100:00100000:3.0:1788612370.988789:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612370.988811:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f965159b going to sleep for 11 seconds 00000100:00100000:2.0:1788612370.988873:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914311936 00000100:00100000:2.0:1788612370.988884:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914311936 00000100:00100000:2.0:1788612370.988907:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788612370.988913:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054736bec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:5849:x1875495914311936:12345-0@lo:501: 00000100:00100000:2.0:1788612370.989150:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054736bec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:5849:x1875495914311936:12345-0@lo:501: Request processed in 237us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612370.989158:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788612370.989296:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f15d41a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914311936:0@lo:501: 00000100:00100000:3.0:1788612370.989323:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f15d41a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914312064:0@lo:503: 00000100:00100000:3.0:1788612370.989356:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612370.989374:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f965159b going to sleep for 11 seconds 00000100:00100000:2.0:1788612370.994909:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312064 00000100:00100000:2.0:1788612370.994924:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312064 00000100:00100000:2.0:1788612370.994998:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788612370.995008:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005faba948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:5849:x1875495914312064:12345-0@lo:503: 00000100:00100000:2.0:1788612370.995262:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005faba948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:5849:x1875495914312064:12345-0@lo:503: Request processed in 255us (5905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612370.995270:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788612370.995979:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f15d41a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914312064:0@lo:503: 00000100:00100000:2.0:1788612371.000481:0:6602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006256bae0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:6602:1875495914312192:0@lo:502: 00000100:00100000:2.0:1788612371.000578:0:6602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612371.000666:0:6602:0:(client.c:2716:ptlrpc_set_wait()) set 00000000442f2d34 going to sleep for 11 seconds 00000100:00100000:1.0:1788612371.018390:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312192 00000100:00100000:1.0:1788612371.018407:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312192 00000100:00100000:1.0:1788612371.018509:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788612371.018529:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e91c652 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:6602:x1875495914312192:12345-0@lo:502: 00000100:00100000:1.0:1788612371.018804:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e91c652 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:6602:x1875495914312192:12345-0@lo:502: Request processed in 286us (18226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612371.018812:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788612371.019636:0:6602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006256bae0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:6602:1875495914312192:0@lo:502: 00000020:01000000:2.0:1788612371.019677:0:6602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612371.019686:0:6602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612371.019689:0:6602:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788612371.019696:0:6602:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff928e98e67000 00000020:00000080:2.0:1788612371.019699:0:6602:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788612371.019749:0:6602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0301880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:6602:1875495914312320:0@lo:502: 00000100:00100000:2.0:1788612371.019799:0:6602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612371.019866:0:6602:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91666f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612371.020139:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312320 00000100:00100000:1.0:1788612371.020144:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312320 00000100:00100000:1.0:1788612371.020283:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788612371.020292:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:6602:x1875495914312320:12345-0@lo:502: 00000100:00100000:1.0:1788612371.020433:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:6602:x1875495914312320:12345-0@lo:502: Request processed in 142us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612371.020452:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788612371.020493:0:6602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0301880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:6602:1875495914312320:0@lo:502: 00000020:01000000:1.0:1788612371.020510:0:6602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612371.020515:0:6602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612371.020517:0:6602:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788612371.020532:0:6602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788612371.020645:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788612371.020666:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788612371.020676:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0145c00/0xfc956d548af41501 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41508 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612371.020694:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ea0145c00/0xfc956d548af41501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41508 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612371.058576:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612372.078455:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612372.525127:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914312448:0@lo:400: 00000100:00100000:3.0:1788612372.525196:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612372.525249:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612372.525255:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914312576:0@lo:400: 00000100:00100000:3.0:1788612372.525277:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612372.525305:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312448 00000100:00100000:1.0:1788612372.525315:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312448 00000100:00100000:1.0:1788612372.525363:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788612372.525374:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:3307:x1875495914312448:12345-0@lo:400: 00000100:00100000:3.0:1788612372.525401:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312576 00000100:00100000:3.0:1788612372.525406:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312576 00000100:00100000:1.0:1788612372.525434:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:3307:x1875495914312448:12345-0@lo:400: Request processed in 62us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612372.525441:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612372.525446:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788612372.525452:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914312576:12345-0@lo:400: 00000100:00100000:3.0:1788612372.525490:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914312576:12345-0@lo:400: Request processed in 42us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612372.525497:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788612372.525721:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff928e98ef6a00 x1875495914312576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612372.525735:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914312576:0@lo:400: 00000100:00100000:3.0:1788612372.525743:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914312448:0@lo:400: 00000020:01000004:0.0:1788612373.093130:0:6694:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788612373.093135:0:6694:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788612373.093283:0:6694:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff928e9162f000 00000020:01000004:0.0:1788612373.093298:0:6694:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788612373.093309:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788612373.093322:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff928e90d3cd40) 00000020:00000080:0.0:1788612373.093337:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00010000:00010000:0.0:1788612373.109490:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788612373.126704:0:6694:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788612373.127168:0:6694:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788612373.167466:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788612373.176136:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788612373.176240:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788612373.176296:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788612373.176321:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788612373.177726:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788612373.177738:0:6694:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788612373.177752:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfc956d548af41516 00000020:01000004:2.0:1788612373.177759:0:6694:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788612373.177779:0:6694:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788612373.177782:0:6694:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788612373.177787:0:6694:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788612373.177900:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788612373.177924:0:6694:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff928ec09299c0) 00000020:00000080:2.0:1788612373.177935:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788612373.180255:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612373.180434:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788612373.180440:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788612373.182140:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788612373.182152:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788612373.182730:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788612373.182737:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788612373.184961:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612373.185140:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788612373.185146:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788612373.191379:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788612373.191395:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788612373.219309:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612373.219561:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788612373.219569:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788612373.221642:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788612373.221654:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788612373.229484:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788612373.229507:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788612373.233240:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612373.235527:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788612373.235537:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788612373.237491:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788612373.237509:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788612373.297749:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612373.298997:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788612373.299006:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788612373.300380:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788612373.300397:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788612373.301158:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788612373.301181:0:6694:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788612373.301187:0:6694:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788612373.327275:0:6694:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788612373.327312:0:6694:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788612373.327316:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788612373.327318:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612373.327319:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612373.327320:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612373.327322:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612373.327323:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612373.327325:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612373.327326:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788612373.327327:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788612373.327329:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612373.327333:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788612373.327336:0:6694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788612373.327338:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788612373.327340:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612373.327341:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612373.327341:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612373.327342:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612373.327343:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612373.327344:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612373.327345:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788612373.327346:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788612373.327347:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612373.327348:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788612373.327373:0:6694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788612373.327450:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914312704:0@lo:253: 00000100:00100000:0.0:1788612373.327538:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612373.327645:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e92599600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612373.328326:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312704 00000100:00100000:3.0:1788612373.328335:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312704 00000100:00100000:3.0:1788612373.328479:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788612373.328489:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:6694:x1875495914312704:12345-0@lo:253: 20000000:01000000:3.0:1788612373.328539:0:5846:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788612373.328543:0:5846:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788612373.328548:0:5846:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788612373.328551:0:5846:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788612373.331551:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788612373.332154:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788612373.332169:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788612373.332204:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788612373.332211:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788612373.332254:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788612373.332306:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788612373.334053:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788612373.334080:0:5846:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.106@tcp 20000000:01000000:3.0:1788612373.334082:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:3.0:1788612373.334114:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788612373.334121:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788612373.334162:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788612373.334169:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:3.0:1788612373.334195:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788612373.334204:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788612373.334228:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788612373.334268:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788612373.335610:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788612373.335646:0:5846:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.106@tcp 20000000:01000000:2.0:1788612373.335648:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:2.0:1788612373.335682:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788612373.335690:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788612373.335714:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788612373.335721:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:2.0:1788612373.335760:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788612373.335769:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788612373.335962:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788612373.336008:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788612373.336025:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788612373.336027:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788612373.336031:0:5846:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788612373.336043:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788612373.336045:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788612373.336078:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788612373.336080:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788612373.336717:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788612373.336995:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788612373.337033:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788612373.337083:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788612373.337093:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788612373.337095:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788612373.338463:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788612373.338533:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788612373.338641:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788612373.339615:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788612373.339661:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788612373.339764:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788612373.339779:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788612373.339781:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788612373.340482:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788612373.340540:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788612373.340656:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788612373.343547:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788612373.343660:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788612373.343779:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788612373.343799:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788612373.343801:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788612373.343810:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788612373.343830:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.344216:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ec21e8e00/0xfc956d548af4143d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41436 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.344225:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e90b61200/0xfc956d548af41459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41452 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.344251:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ea0145000/0xfc956d548af414c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af414c2 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.344258:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.344296:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ea0145000/0xfc956d548af414c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af414c2 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.344311:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928ea0145000/0xfc956d548af414c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af414c2 expref: 12 pid: 5847 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612373.344326:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875495914312832:0@lo:104: 00000100:00100000:3.0:1788612373.344382:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612373.344540:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e90b61200/0xfc956d548af41459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af41452 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.344549:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e90b61200/0xfc956d548af41459 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af41452 expref: 12 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612373.344568:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875495914312960:0@lo:104: 00000100:00100000:3.0:1788612373.344588:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612373.344932:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ec21e8e00/0xfc956d548af4143d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af41436 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.344941:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928ec21e8e00/0xfc956d548af4143d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af41436 expref: 12 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612373.344949:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875495914313088:0@lo:104: 00000100:00100000:3.0:1788612373.344975:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612373.345031:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312832 00000100:00100000:0.0:1788612373.345038:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312832 00000100:00100000:2.0:1788612373.345086:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914312960 00000100:00100000:2.0:1788612373.345090:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914312960 00000100:00100000:2.0:1788612373.345110:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612373.345117:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+4:5846:x1875495914312832:12345-0@lo:104: 00010000:00010000:2.0:1788612373.345131:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e80030000/0xfc956d548af414c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af414c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.345182:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612373.345187:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+4:5846:x1875495914312832:12345-0@lo:104: Request processed in 70us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612373.345194:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612373.345211:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612373.345216:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+3:5846:x1875495914312960:12345-0@lo:104: 00010000:00010000:2.0:1788612373.345224:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e80030c00/0xfc956d548af41452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41459 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.345249:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788612373.345254:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+3:5846:x1875495914312960:12345-0@lo:104: Request processed in 38us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612373.345259:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788612373.345275:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788612373.345281:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e80030000/0xfc956d548af414c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af414c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.345288:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612373.345292:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e80030000/0xfc956d548af414c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af414c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.345301:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e80030000/0xfc956d548af414c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af414c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612373.345309:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e80030000/0xfc956d548af414c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af414c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612373.345314:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612373.345345:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e80030000/0xfc956d548af414c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af414c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.345352:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612373.345371:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e80030000/0xfc956d548af414c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af414c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.345379:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e80030000/0xfc956d548af414c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af414c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.345406:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612373.345410:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e80030c00/0xfc956d548af41452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41459 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.345416:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030c00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612373.345419:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e80030c00/0xfc956d548af41452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af41459 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.345426:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e80030c00/0xfc956d548af41452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af41459 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612373.345432:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e80030c00/0xfc956d548af41452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af41459 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612373.345437:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612373.345447:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e80030c00/0xfc956d548af41452 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41459 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.345453:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612373.345458:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e80030c00/0xfc956d548af41452 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41459 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.345474:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e80030c00/0xfc956d548af41452 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41459 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.345483:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612373.345485:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612373.345486:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612373.345517:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914313216:0@lo:103: 00000100:00100000:2.0:1788612373.345542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612373.345636:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612373.346203:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c7e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612373.346229:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875495914312832:0@lo:104: 00000100:00100000:3.0:1788612373.346238:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875495914312960:0@lo:104: 00000100:00100000:3.0:1788612373.349918:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313216 00000100:00100000:3.0:1788612373.349934:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313216 00010000:00010000:3.0:1788612373.350118:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ea0145000/0xfc956d548af414c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af414c2 expref: 13 pid: 5847 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612373.350145:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612373.350152:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0300e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22c69a0a-d366-4936-9310-01935a424f88+13:3305:x1875495914313216:12345-0@lo:103: 00010000:00010000:3.0:1788612373.350163:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612373.350167:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ea0145000/0xfc956d548af414c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af414c2 expref: 13 pid: 5847 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.350176:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ea0145000/0xfc956d548af414c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af414c2 expref: 13 pid: 5847 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.350190:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea0145000/0xfc956d548af414c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af414c2 expref: 13 pid: 5847 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.350205:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612373.350248:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0300e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22c69a0a-d366-4936-9310-01935a424f88+12:3305:x1875495914313216:12345-0@lo:103: Request processed in 98us (4706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.350253:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612373.350281:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914313344:0@lo:103: 00000100:00100000:3.0:1788612373.350308:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612373.350376:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914313216:0@lo:103: 00000100:00100000:2.0:1788612373.351185:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313088 00000100:00100000:2.0:1788612373.351192:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313088 00000100:00100000:2.0:1788612373.351218:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788612373.351225:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+3:5846:x1875495914313088:12345-0@lo:104: 00010000:00010000:2.0:1788612373.351239:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4143d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.351314:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612373.351321:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+3:5846:x1875495914313088:12345-0@lo:104: Request processed in 96us (6345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612373.351329:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612373.351339:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875495914313088:0@lo:104: 00010000:00010000:2.0:1788612373.351350:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612373.351359:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4143d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.351367:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030400 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612373.351372:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af4143d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.351375:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.351458:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af4143d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612373.351466:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af4143d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612373.351473:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612373.351521:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41436 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4143d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.351528:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612373.351545:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41436 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4143d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.351895:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41436 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4143d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.351913:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612373.351915:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612373.351917:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612373.351929:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914313472:0@lo:103: 00000100:00100000:2.0:1788612373.351969:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612373.352010:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313344 00000100:00100000:2.0:1788612373.352015:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313344 00010000:00010000:2.0:1788612373.352032:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e90b61200/0xfc956d548af41459 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41452 expref: 12 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612373.352046:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313472 00000100:00100000:2.0:1788612373.352048:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313472 00010000:00010000:2.0:1788612373.352064:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ec21e8e00/0xfc956d548af4143d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41436 expref: 13 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612373.352076:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612373.352082:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22c69a0a-d366-4936-9310-01935a424f88+13:3306:x1875495914313344:12345-0@lo:103: 00010000:00010000:2.0:1788612373.352090:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612373.352094:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e90b61200/0xfc956d548af41459 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41452 expref: 13 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352104:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e90b61200/0xfc956d548af41459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af41452 expref: 13 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352116:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b61200/0xfc956d548af41459 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af41452 expref: 13 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352127:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612373.352154:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22c69a0a-d366-4936-9310-01935a424f88+12:3306:x1875495914313344:12345-0@lo:103: Request processed in 72us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612373.352160:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612373.352178:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788612373.352184:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0303480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22c69a0a-d366-4936-9310-01935a424f88+11:3307:x1875495914313472:12345-0@lo:103: 00010000:00010000:2.0:1788612373.352191:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612373.352194:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ec21e8e00/0xfc956d548af4143d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41436 expref: 11 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352203:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ec21e8e00/0xfc956d548af4143d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af41436 expref: 11 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352213:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e8e00/0xfc956d548af4143d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af41436 expref: 11 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352233:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352242:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352256:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352263:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352270:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352277:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352282:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0145200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612373.352286:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352294:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352307:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.352320:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612373.352342:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0303480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22c69a0a-d366-4936-9310-01935a424f88+10:3307:x1875495914313472:12345-0@lo:103: Request processed in 159us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612373.352356:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788612373.352379:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914313472:0@lo:103: 00000100:00100000:2.0:1788612373.353491:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914313344:0@lo:103: 00010000:00010000:2.0:1788612373.353543:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.354102:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.354113:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea0145200/0xfc956d548af41524 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788612373.354128:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788612373.418416:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+9:6694:x1875495914312704:12345-0@lo:253: Request processed in 89921us (90870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612373.418430:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788612373.418599:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914312704:0@lo:253: 10000000:01000000:0.0:1788612373.418614:0:6694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788612373.418617:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788612373.418619:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612373.418620:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612373.418622:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788612373.418623:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612373.418625:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612373.418626:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612373.418628:0:6694:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788612373.418629:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612373.418630:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788612373.418648:0:6694:0:(tgt_mount.c:101:server_register_mount()) register mount ffff928e9162f000 from lustre-OST0000 10000000:01000000:0.0:1788612373.418680:0:6694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788612373.418683:0:6694:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788612373.418689:0:6694:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff928e90d3b380 local copy 10000000:01000000:0.0:1788612373.418693:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788612373.418738:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612373.418749:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612373.418759:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612373.418776:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914313600:0@lo:101: 00000100:00100000:0.0:1788612373.418807:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612373.418881:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612373.418975:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313600 00000100:00100000:2.0:1788612373.418981:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313600 00000100:00100000:2.0:1788612373.419019:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788612373.419028:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+9:6694:x1875495914313600:12345-0@lo:101: 00010000:00010000:2.0:1788612373.419040:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612373.419054:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e8e00/0xfc956d548af41532 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af4152b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.419077:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e8e00/0xfc956d548af41532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af4152b expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.419087:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e8e00/0xfc956d548af41532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4152b expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.419113:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8e00, rc 0) 00000100:00100000:2.0:1788612373.419146:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+10:6694:x1875495914313600:12345-0@lo:101: Request processed in 119us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612373.419152:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788612373.419296:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914313600:0@lo:101: 00010000:00010000:0.0:1788612373.419308:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xfc956d548af41532 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612373.419317:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfc956d548af41532 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612373.419458:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914313728:0@lo:501: 00000100:00100000:0.0:1788612373.419483:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612373.419514:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612373.419608:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313728 00000100:00100000:2.0:1788612373.419612:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313728 00000100:00100000:2.0:1788612373.419639:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788612373.419646:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+10:6694:x1875495914313728:12345-0@lo:501: 00000100:00100000:2.0:1788612373.419823:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+10:6694:x1875495914313728:12345-0@lo:501: Request processed in 177us (339us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788612373.419830:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788612373.419970:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914313728:0@lo:501: 10000000:01000000:0.0:1788612373.419982:0:6694:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788612373.420007:0:6694:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788612373.420019:0:6694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfc956d548af41532 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612373.420028:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfc956d548af41532 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612373.420035:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfc956d548af41532 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612373.420056:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788612373.420075:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff928e9162f000 10000000:01000000:0.0:1788612373.420079:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788612373.420083:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff928e90d3b380 10000000:01000000:0.0:1788612373.420086:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788612373.420089:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff928e90d3b380 from 1 10000000:01000000:0.0:1788612373.420092:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788612373.420116:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6800/0xfc956d548af41539 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612373.420123:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e910d6800/0xfc956d548af41539 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612373.420132:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d6800/0xfc956d548af41539 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612373.420144:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914313856:0@lo:101: 00000100:00100000:0.0:1788612373.420167:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612373.420183:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cd000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612373.420278:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313856 00000100:00100000:3.0:1788612373.420283:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313856 00000100:00100000:3.0:1788612373.420317:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788612373.420323:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+10:6694:x1875495914313856:12345-0@lo:101: 00010000:00010000:3.0:1788612373.420331:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612373.420342:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea0145000/0xfc956d548af41540 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41539 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.420358:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea0145000/0xfc956d548af41540 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41539 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.420367:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea0145000/0xfc956d548af41540 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41539 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.420375:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0145000, rc 0) 00000100:00100000:3.0:1788612373.420412:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+11:6694:x1875495914313856:12345-0@lo:101: Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.420418:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1788612373.420530:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612373.420536:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xfc956d548af41532 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.420544:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d6a00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612373.420548:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xfc956d548af41532 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.420616:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xfc956d548af41532 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612373.420625:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xfc956d548af41532 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612373.420631:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612373.420649:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xfc956d548af41532 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.420668:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612373.420693:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xfc956d548af41532 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.420701:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af4152b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xfc956d548af41532 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.420715:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612373.420717:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612373.420719:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612373.420726:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612373.420737:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914313984:0@lo:103: 00000100:00100000:2.0:1788612373.420765:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612373.420790:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914313984 00000100:00100000:2.0:1788612373.420794:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914313984 00000100:00100000:2.0:1788612373.420823:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612373.420830:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0302300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22c69a0a-d366-4936-9310-01935a424f88+11:3307:x1875495914313984:12345-0@lo:103: 00010000:00010000:2.0:1788612373.420878:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612373.420890:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e8e00/0xfc956d548af41532 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af4152b expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.420903:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612373.420927:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0302300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22c69a0a-d366-4936-9310-01935a424f88+10:3307:x1875495914313984:12345-0@lo:103: Request processed in 97us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612373.420932:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612373.420959:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914313984:0@lo:103: 00000100:00100000:0.0:1788612373.421035:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914313856:0@lo:101: 00010000:00010000:0.0:1788612373.421046:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d6800/0xfc956d548af41539 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41540 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612373.421060:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d6800/0xfc956d548af41539 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41540 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612373.421075:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788612373.421089:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6800/0xfc956d548af41539 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41540 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612373.421105:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e910d6800/0xfc956d548af41539 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41540 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612373.421112:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788612373.421116:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788612373.421121:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788612373.421123:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788612373.421136:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612373.421143:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612373.421150:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612373.421162:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914314112:0@lo:101: 00000100:00100000:0.0:1788612373.421184:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612373.421199:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cd000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612373.421326:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914314112 00000100:00100000:3.0:1788612373.421331:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914314112 00000100:00100000:3.0:1788612373.421357:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788612373.421363:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+10:6694:x1875495914314112:12345-0@lo:101: 00010000:00010000:3.0:1788612373.421371:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612373.421380:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea0145200/0xfc956d548af4154e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41547 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.421491:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea0145200/0xfc956d548af4154e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41547 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.421510:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea0145200/0xfc956d548af4154e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41547 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.421517:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0145200, rc 0) 00000100:00100000:3.0:1788612373.421550:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+11:6694:x1875495914314112:12345-0@lo:101: Request processed in 187us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.421615:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788612373.421683:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914314112:0@lo:101: 00010000:00010000:0.0:1788612373.421693:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4154e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612373.421706:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4154e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612373.421773:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914314240:0@lo:501: 00000100:00100000:0.0:1788612373.421794:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612373.421814:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cd000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612373.421883:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914314240 00000100:00100000:2.0:1788612373.421892:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914314240 00000100:00100000:2.0:1788612373.421952:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788612373.421959:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+11:6694:x1875495914314240:12345-0@lo:501: 00000100:00100000:2.0:1788612373.422145:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+11:6694:x1875495914314240:12345-0@lo:501: Request processed in 186us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612373.422152:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788612373.422208:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914314240:0@lo:501: 00000100:00100000:0.0:1788612373.422231:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914314368:0@lo:503: 00000100:00100000:0.0:1788612373.422264:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612373.422507:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cd000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612373.422625:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914314368 00000100:00100000:3.0:1788612373.422629:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914314368 00000100:00100000:3.0:1788612373.422649:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788612373.422655:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+11:6694:x1875495914314368:12345-0@lo:503: 00000100:00100000:3.0:1788612373.422794:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+11:6694:x1875495914314368:12345-0@lo:503: Request processed in 138us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.422801:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788612373.422879:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914314368:0@lo:503: 00000040:00080000:0.0:1788612373.423128:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788612373.423189:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914314496:0@lo:502: 00000100:00100000:0.0:1788612373.423217:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612373.423243:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cd000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612373.423336:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914314496 00000100:00100000:3.0:1788612373.423340:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914314496 00000100:00100000:3.0:1788612373.423357:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788612373.423361:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+11:6694:x1875495914314496:12345-0@lo:502: 00000100:00100000:3.0:1788612373.423484:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+11:6694:x1875495914314496:12345-0@lo:502: Request processed in 122us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.423491:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788612373.423665:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914314496:0@lo:502: 00000040:00080000:0.0:1788612373.423938:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788612373.423981:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788612373.424010:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788612373.424055:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788612373.424085:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788612373.424126:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788612373.424146:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914314624:0@lo:502: 00000100:00100000:0.0:1788612373.424177:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612373.424188:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cd000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612373.424298:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914314624 00000100:00100000:2.0:1788612373.424304:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914314624 00000100:00100000:2.0:1788612373.424326:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788612373.424332:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+11:6694:x1875495914314624:12345-0@lo:502: 00000100:00100000:2.0:1788612373.424458:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+11:6694:x1875495914314624:12345-0@lo:502: Request processed in 125us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612373.424465:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788612373.424673:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914314624:0@lo:502: 00000040:00080000:0.0:1788612373.424740:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788612373.424749:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788612373.425338:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788612373.425345:0:6711:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788612373.425351:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612373.425354:0:6711:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788612373.425358:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788612373.425371:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff928e90d399c0) 00000020:00000080:0.0:1788612373.425450:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788612373.425458:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788612373.425521:0:6711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff928e9162f000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788612373.425527:0:6711:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788612373.425535:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfc956d548af4155c 00010000:00010000:2.0:1788612373.429678:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788612373.430219:0:6711:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788612373.435961:0:6711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788612373.436374:0:6711:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788612373.447517:0:6711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788612373.449142:0:6711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788612373.452031:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788612373.452047:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612373.452053:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612373.452056:0:6711:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788612373.452059:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612373.452063:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612373.452065:0:6711:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788612373.452068:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788612373.452070:0:6711:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788612373.452134:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612373.452137:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612373.452138:0:6711:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788612373.452141:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788612373.452321:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788612373.452346:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788612373.452368:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4154e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.452380:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4154e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612373.452389:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928e9162f000 from 1 10000000:01000000:2.0:1788612373.452392:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612373.452441:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.452449:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.452477:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612373.452512:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0303100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914314752:0@lo:101: 00000100:00100000:2.0:1788612373.452577:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612373.452630:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eadfc66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612373.452656:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914314752 00000100:00100000:2.0:1788612373.452662:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914314752 00000100:00100000:2.0:1788612373.452711:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788612373.452719:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+11:6694:x1875495914314752:12345-0@lo:101: 00010000:00010000:2.0:1788612373.452730:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612373.452741:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e8400/0xfc956d548af4156a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41563 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.452762:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e8400/0xfc956d548af4156a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41563 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.452773:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e8400/0xfc956d548af4156a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41563 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.452782:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8400, rc 0) 00000100:00100000:2.0:1788612373.452816:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:6694:x1875495914314752:12345-0@lo:101: Request processed in 98us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612373.452822:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788612373.452895:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0303100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914314752:0@lo:101: 00010000:00010000:2.0:1788612373.452907:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4156a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.452926:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4156a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612373.453001:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0303100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914314880:0@lo:501: 00000100:00100000:2.0:1788612373.453025:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612373.453039:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eadfc66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612373.454715:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914314880 00000100:00100000:2.0:1788612373.454727:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914314880 00000100:00100000:2.0:1788612373.454776:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788612373.454784:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:6694:x1875495914314880:12345-0@lo:501: 00000100:00100000:2.0:1788612373.455048:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:6694:x1875495914314880:12345-0@lo:501: Request processed in 264us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612373.455055:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788612373.455154:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0303100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914314880:0@lo:501: 00000100:00100000:0.0:1788612373.455192:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315008:0@lo:503: 00000100:00100000:0.0:1788612373.455230:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612373.455260:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788612373.455367:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315008 00000100:00100000:3.0:1788612373.455371:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315008 00000100:00100000:3.0:1788612373.455402:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788612373.455409:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:6694:x1875495914315008:12345-0@lo:503: 00000100:00100000:3.0:1788612373.455638:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:6694:x1875495914315008:12345-0@lo:503: Request processed in 229us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.455645:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788612373.455799:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315008:0@lo:503: 00000040:00080000:0.0:1788612373.456060:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788612373.456125:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315136:0@lo:502: 00000100:00100000:0.0:1788612373.456155:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612373.456178:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788612373.456279:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315136 00000100:00100000:3.0:1788612373.456283:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315136 00000100:00100000:3.0:1788612373.456303:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788612373.456308:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:6694:x1875495914315136:12345-0@lo:502: 00000100:00100000:3.0:1788612373.456438:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:6694:x1875495914315136:12345-0@lo:502: Request processed in 129us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.456445:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788612373.456551:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315136:0@lo:502: 00000040:00080000:0.0:1788612373.460666:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788612373.460749:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788612373.460791:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315264:0@lo:502: 00000100:00100000:0.0:1788612373.460885:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612373.460934:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788612373.461125:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315264 00000100:00100000:3.0:1788612373.461133:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315264 00000100:00100000:3.0:1788612373.461186:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788612373.461194:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:6694:x1875495914315264:12345-0@lo:502: 00000100:00100000:3.0:1788612373.461351:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:6694:x1875495914315264:12345-0@lo:502: Request processed in 157us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.461358:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788612373.461484:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315264:0@lo:502: 00000040:00080000:0.0:1788612373.461572:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788612373.461581:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788612373.466017:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612373.466117:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612373.466120:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788612373.466128:0:6715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff928e9162f000 00000020:00000080:2.0:1788612373.466131:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788612373.466157:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612373.466159:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612373.466161:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788612373.466164:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788612373.466232:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788612373.466263:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788612373.466286:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4156a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.466299:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4156a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612373.466340:0:6694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788612373.466343:0:6694:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff928e9162f000 10000000:01000000:3.0:1788612373.466346:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff928e9162f000 10000000:01000000:3.0:1788612373.466350:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788612373.466355:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff928e9162f000 from 1 10000000:01000000:3.0:1788612373.466357:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788612373.466392:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.466400:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.466411:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612373.466432:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315392:0@lo:101: 00000100:00100000:3.0:1788612373.466490:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612373.466558:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c7e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788612373.466622:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315392 00000100:00100000:2.0:1788612373.466629:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315392 00000100:00100000:2.0:1788612373.466670:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788612373.466679:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:6694:x1875495914315392:12345-0@lo:101: 00010000:00010000:2.0:1788612373.466692:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612373.466710:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e9e00/0xfc956d548af41578 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41571 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.466736:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e9e00/0xfc956d548af41578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41571 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.466749:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e9e00/0xfc956d548af41578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41571 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.466759:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9e00, rc 0) 00000100:00100000:2.0:1788612373.466811:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:6694:x1875495914315392:12345-0@lo:101: Request processed in 128us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612373.466818:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788612373.466997:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315392:0@lo:101: 00010000:00010000:1.0:1788612373.467012:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41578 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612373.467022:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41578 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612373.467124:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315520:0@lo:501: 00000100:00100000:1.0:1788612373.467149:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612373.467232:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacf43480 going to sleep for 11 seconds 00000100:00100000:3.0:1788612373.467325:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315520 00000100:00100000:3.0:1788612373.467330:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315520 00000100:00100000:3.0:1788612373.467359:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788612373.467365:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+13:6694:x1875495914315520:12345-0@lo:501: 00000100:00100000:3.0:1788612373.467651:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+13:6694:x1875495914315520:12345-0@lo:501: Request processed in 285us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.467658:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788612373.467773:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315520:0@lo:501: 00000100:00100000:1.0:1788612373.467804:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315648:0@lo:503: 00000100:00100000:1.0:1788612373.467923:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612373.467968:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacf43480 going to sleep for 11 seconds 00000100:00100000:3.0:1788612373.467998:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315648 00000100:00100000:3.0:1788612373.468003:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315648 00000100:00100000:3.0:1788612373.468057:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788612373.468066:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:6694:x1875495914315648:12345-0@lo:503: 00000100:00100000:3.0:1788612373.468273:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:6694:x1875495914315648:12345-0@lo:503: Request processed in 208us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.468279:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788612373.468339:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315648:0@lo:503: 00000040:00080000:2.0:1788612373.468625:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788612373.468693:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315776:0@lo:502: 00000100:00100000:2.0:1788612373.468730:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612373.468899:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315776 00000100:00100000:1.0:1788612373.468904:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315776 00000100:00100000:1.0:1788612373.468927:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788612373.468934:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+13:6694:x1875495914315776:12345-0@lo:502: 00000100:00100000:1.0:1788612373.469090:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+13:6694:x1875495914315776:12345-0@lo:502: Request processed in 157us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612373.469226:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788612373.469325:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eadfc69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612373.469340:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315776:0@lo:502: 00000040:00080000:2.0:1788612373.469596:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788612373.469690:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788612373.469718:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788612373.469756:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788612373.469787:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788612373.469827:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788612373.470023:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788612373.470056:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788612373.470157:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788612373.470206:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788612373.470247:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788612373.470299:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788612373.470332:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788612373.470358:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788612373.470410:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788612373.470453:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788612373.470481:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788612373.470556:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788612373.470598:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788612373.470945:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788612373.470994:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788612373.471027:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788612373.471069:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788612373.471185:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788612373.471223:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788612373.471263:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788612373.471325:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788612373.471358:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788612373.471397:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315904:0@lo:502: 00000100:00100000:2.0:1788612373.471462:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612373.471556:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e871789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612373.471598:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914315904 00000100:00100000:3.0:1788612373.471671:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914315904 00000100:00100000:3.0:1788612373.471744:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788612373.471754:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:6694:x1875495914315904:12345-0@lo:502: 00000100:00100000:3.0:1788612373.471982:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:6694:x1875495914315904:12345-0@lo:502: Request processed in 229us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.471990:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788612373.472084:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914315904:0@lo:502: 00000040:00080000:2.0:1788612373.472159:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788612373.472168:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788612373.473078:0:6716:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788612373.473171:0:6716:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff928ec0928000) 00000020:00000080:2.0:1788612373.473192:0:6716:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788612373.473263:0:6716:0:(tgt_mount.c:153:server_get_mount()) get mount ffff928e9162f000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788612373.473267:0:6716:0:(tgt_mount.c:187:server_put_mount()) put mount ffff928e9162f000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788612373.473269:0:6716:0:(obd_mount.c:710:lustre_put_lsi()) put ffff928e9162f000 3 00010000:00080000:2.0:1788612373.473301:0:6716:0:(ldlm_lib.c:102:import_set_conn()) imp ffff928e86c05000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1788612373.475432:0:6716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788612373.475690:0:6716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788612373.475724:0:6716:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788612373.475736:0:6716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xfc956d548af41586 00000100:00080000:2.0:1788612373.475747:0:6716:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612373.475755:0:6716:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff928e86c05000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1788612373.475792:0:6716:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928ec0300000 x1875495914316032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788612373.475823:0:6716:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788612373.475902:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914316160:0@lo:400: 00000100:00100000:2.0:1788612373.475959:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612373.476156:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875495914316032:0@lo:38: 00000100:00100000:3.0:1788612373.476186:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612373.476223:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316160 00000100:00100000:3.0:1788612373.476229:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316160 00000100:00100000:3.0:1788612373.476270:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316032 00000100:00100000:3.0:1788612373.476273:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316032 00000100:00100000:3.0:1788612373.476293:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612373.476300:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914316160:12345-0@lo:400: 00000100:00100000:3.0:1788612373.476346:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914316160:12345-0@lo:400: Request processed in 46us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.476353:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612373.476367:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612373.476371:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875495914316032:12345-0@lo:38: 00010000:00080000:3.0:1788612373.476389:0:5854:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:3.0:1788612373.476415:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xfc956d548af4158d 00000004:00100000:3.0:1788612373.476428:0:5854:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788612373.476452:0:5854:0:(import.c:65:import_set_state_nolock()) ffff928d85250000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612373.476482:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875495914316032:12345-0@lo:38: Request processed in 109us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.476488:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788612373.476534:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff928ec0300000 x1875495914316032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612373.476543:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788612373.476550:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788612373.476556:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788612373.476560:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788612373.476563:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928e86c05000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788612373.476569:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875495914316032:0@lo:38: 00010000:00080000:3.0:1788612373.476594:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff928ec0301f80 x1875495914316160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612373.476707:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914316160:0@lo:400: 00000040:00080000:2.0:1788612373.477037:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788612373.477934:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788612373.477958:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788612373.478012:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41578 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612373.478023:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41578 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788612373.478064:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788612373.478066:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788612373.478068:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612373.478069:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612373.478071:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612373.478072:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612373.478073:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612373.478075:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788612373.478076:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788612373.478078:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612373.478079:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788612373.478086:0:6694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788612373.478088:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788612373.478089:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788612373.478090:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612373.478092:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612373.478093:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612373.478103:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612373.478104:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612373.478105:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788612373.478106:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788612373.478108:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612373.478109:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788612373.478125:0:6694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788612373.478137:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0302680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914316288:0@lo:253: 00000100:00100000:2.0:1788612373.478181:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612373.478211:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e87178840 going to sleep for 11 seconds 00000100:00100000:0.0:1788612373.478832:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316288 00000100:00100000:0.0:1788612373.478850:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316288 00000100:00100000:0.0:1788612373.478885:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788612373.478892:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:6694:x1875495914316288:12345-0@lo:253: 20000000:01000000:0.0:1788612373.478913:0:5847:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788612373.478925:0:5847:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788612373.494999:0:5847:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788612373.495020:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788612373.495159:0:5868:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788612373.495164:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788612373.495185:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495203:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e80030600/0xfc956d548af414ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af414e5 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495212:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495250:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e80030600/0xfc956d548af414ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af414e5 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495264:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e80030600/0xfc956d548af414ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af414e5 expref: 13 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612373.495279:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1875495914316416:0@lo:104: 00000100:00100000:3.0:1788612373.495337:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612373.495416:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c7e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612373.495440:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316416 00000100:00100000:3.0:1788612373.495448:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316416 00000100:00100000:3.0:1788612373.495492:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612373.495515:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+3:5868:x1875495914316416:12345-0@lo:104: 00010000:00010000:3.0:1788612373.495528:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e90b60200/0xfc956d548af414e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af414ec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495572:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788612373.495578:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+3:5868:x1875495914316416:12345-0@lo:104: Request processed in 65us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.495595:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788612373.495616:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612373.495621:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e90b60200/0xfc956d548af414e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af414ec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495628:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788612373.495633:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e90b60200/0xfc956d548af414e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af414ec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495641:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e90b60200/0xfc956d548af414e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af414ec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612373.495649:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e90b60200/0xfc956d548af414e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af414ec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612373.495655:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612373.495679:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e90b60200/0xfc956d548af414e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af414ec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495686:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612373.495702:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e90b60200/0xfc956d548af414e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af414ec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495709:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e90b60200/0xfc956d548af414e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af414ec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495724:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612373.495725:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612373.495727:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612373.495742:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914316544:0@lo:103: 00000100:00100000:3.0:1788612373.495784:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612373.495816:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316544 00000100:00100000:3.0:1788612373.495819:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316544 00010000:00010000:3.0:1788612373.495834:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e80030600/0xfc956d548af414ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af414e5 expref: 14 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612373.495876:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612373.495882:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9238f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+14:3306:x1875495914316544:12345-0@lo:103: 00010000:00010000:3.0:1788612373.495892:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612373.495896:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e80030600/0xfc956d548af414ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af414e5 expref: 14 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495907:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e80030600/0xfc956d548af414ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af414e5 expref: 14 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495922:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495930:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788612373.495942:0:5839:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001838020s 00010000:00010000:3.0:1788612373.495945:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495953:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495960:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495976:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495982:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0145a00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612373.495986:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.495994:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.496002:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.496010:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612373.496037:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9238f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+14:3306:x1875495914316544:12345-0@lo:103: Request processed in 155us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612373.496044:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612373.496700:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914316544:0@lo:103: 00010000:00010000:3.0:1788612373.496735:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e80030600/0xfc956d548af414ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af414e5 expref: 13 pid: 5846 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612373.496747:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1875495914316416:0@lo:104: 00010000:00010000:3.0:1788612373.496758:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.496766:0:5868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.496773:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612373.496785:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea0145a00/0xfc956d548af41594 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612373.503992:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:6694:x1875495914316288:12345-0@lo:253: Request processed in 25091us (25800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612373.504008:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788612373.504230:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0302680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:6694:1875495914316288:0@lo:253: 10000000:01000000:2.0:1788612373.504244:0:6694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788612373.504247:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788612373.504249:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788612373.504250:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612373.504252:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612373.504253:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612373.504255:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612373.504256:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612373.504258:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788612373.504259:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788612373.504260:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612373.504261:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788612373.504272:0:6694:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788612373.508778:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788612373.509393:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788612373.509601:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788612373.509739:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788612373.510055:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788612373.510347:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788612373.511366:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788612373.694570:0:6694:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788612373.694577:0:6694:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788612373.694676:0:6694:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788612373.694797:0:6694:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788612373.694813:0:6694:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788612373.694916:0:6694:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788612374.126680:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612375.148666:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612376.172199:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612377.198192:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612378.225868:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612378.669644:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914316800:0@lo:400: 00000100:00100000:1.0:1788612378.669744:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612378.669878:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612378.669891:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914316672:0@lo:400: 00000100:00100000:1.0:1788612378.669955:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612378.670003:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914316928:0@lo:400: 00000100:00100000:1.0:1788612378.670062:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612378.670136:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316800 00000100:00100000:1.0:1788612378.670146:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316800 00000100:00100000:1.0:1788612378.670194:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316928 00000100:00100000:1.0:1788612378.670197:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316928 00000100:00100000:1.0:1788612378.670240:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612378.670248:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914316800:12345-0@lo:400: 00000100:00100000:1.0:1788612378.670299:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914316800:12345-0@lo:400: Request processed in 51us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612378.670307:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612378.670321:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612378.670327:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914316928:12345-0@lo:400: 00000100:00100000:1.0:1788612378.670356:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914316928:12345-0@lo:400: Request processed in 30us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612378.670362:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788612378.670406:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ebf81f100 x1875495914316800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612378.670419:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914316800:0@lo:400: 00010000:00080000:1.0:1788612378.670455:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ebf81ce00 x1875495914316928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612378.670464:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914316928:0@lo:400: 00000100:00080000:2.0:1788612378.671296:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612378.671437:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914316672 00000100:00100000:0.0:1788612378.671455:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914316672 00000100:00100000:0.0:1788612378.671507:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788612378.671515:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:3308:x1875495914316672:12345-0@lo:400: 00000100:00100000:0.0:1788612378.671579:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:3308:x1875495914316672:12345-0@lo:400: Request processed in 65us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612378.671586:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788612378.671645:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914316672:0@lo:400: 00010000:00010000:2.0:1788612379.254233:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788612380.212775:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788612380.212783:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff928e98e67000 from 21 10000000:01000000:0.0:1788612380.212788:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788612380.212849:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612380.212871:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612380.212883:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612380.212906:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914317056:0@lo:101: 00000100:00100000:0.0:1788612380.212972:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612380.213015:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91082d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612380.217323:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317056 00000100:00100000:2.0:1788612380.217339:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317056 00000100:00100000:2.0:1788612380.217399:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788612380.217409:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:5849:x1875495914317056:12345-0@lo:101: 00010000:00010000:2.0:1788612380.217434:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612380.217452:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e8600/0xfc956d548af415a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af4159b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612380.217477:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e8600/0xfc956d548af415a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af4159b expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612380.217488:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e8600/0xfc956d548af415a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4159b expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612380.217497:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8600, rc 0) 00000100:00100000:2.0:1788612380.217561:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:5849:x1875495914317056:12345-0@lo:101: Request processed in 154us (4588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612380.217567:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788612380.217912:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914317056:0@lo:101: 00010000:00010000:0.0:1788612380.217937:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af415a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612380.217947:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af415a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612380.218011:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914317184:0@lo:501: 00000100:00100000:0.0:1788612380.218051:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612380.218080:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91082d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612380.218866:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317184 00000100:00100000:2.0:1788612380.218873:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317184 00000100:00100000:2.0:1788612380.218899:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788612380.218914:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+13:5849:x1875495914317184:12345-0@lo:501: 00000100:00100000:2.0:1788612380.219451:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+13:5849:x1875495914317184:12345-0@lo:501: Request processed in 535us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612380.219459:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788612380.221039:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914317184:0@lo:501: 00000100:00100000:0.0:1788612380.221105:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914317312:0@lo:503: 00000100:00100000:0.0:1788612380.221270:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612380.221306:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317312 00000100:00100000:0.0:1788612380.221312:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317312 00000100:00100000:0.0:1788612380.221352:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788612380.221359:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:5849:x1875495914317312:12345-0@lo:503: 00000100:00100000:0.0:1788612380.221670:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:5849:x1875495914317312:12345-0@lo:503: Request processed in 310us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612380.221677:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788612380.221722:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91082d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612380.221733:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914317312:0@lo:503: 00000100:00100000:2.0:1788612380.224788:0:6999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0302680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:6999:1875495914317440:0@lo:502: 00000100:00100000:2.0:1788612380.225058:0:6999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612380.225356:0:6999:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612380.230043:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317440 00000100:00100000:1.0:1788612380.230059:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317440 00000100:00100000:1.0:1788612380.230134:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788612380.230145:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:6999:x1875495914317440:12345-0@lo:502: 00000100:00100000:1.0:1788612380.230612:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:6999:x1875495914317440:12345-0@lo:502: Request processed in 469us (5555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612380.230620:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788612380.233352:0:6999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0302680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:6999:1875495914317440:0@lo:502: 00000100:00100000:2.0:1788612380.233450:0:6999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0302680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:6999:1875495914317568:0@lo:502: 00000100:00100000:2.0:1788612380.233524:0:6999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612380.233576:0:6999:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612380.233658:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317568 00000100:00100000:0.0:1788612380.233665:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317568 00000100:00100000:0.0:1788612380.233723:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788612380.233731:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+13:6999:x1875495914317568:12345-0@lo:502: 00000100:00100000:0.0:1788612380.233990:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+13:6999:x1875495914317568:12345-0@lo:502: Request processed in 258us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612380.233997:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788612380.236143:0:6999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0302680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:6999:1875495914317568:0@lo:502: 00000040:00080000:2.0:1788612380.236215:0:6999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788612380.236444:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788612380.236472:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788612380.236487:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af415a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612380.236499:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af415a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612380.236509:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788612380.236512:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff928e98e67000 from 4 10000000:01000000:0.0:1788612380.236514:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788612380.236551:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612380.236560:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612380.236585:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612380.236603:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914317696:0@lo:101: 00000100:00100000:0.0:1788612380.236657:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612380.236701:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e910820c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612380.237085:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317696 00000100:00100000:1.0:1788612380.237102:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317696 00000100:00100000:1.0:1788612380.237158:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788612380.237175:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:5849:x1875495914317696:12345-0@lo:101: 00010000:00010000:1.0:1788612380.237188:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612380.237200:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b60200/0xfc956d548af415b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af415a9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612380.237223:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b60200/0xfc956d548af415b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af415a9 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612380.237233:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b60200/0xfc956d548af415b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af415a9 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612380.237243:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60200, rc 0) 00000100:00100000:1.0:1788612380.237294:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914317696:12345-0@lo:101: Request processed in 121us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612380.237300:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788612380.237502:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914317696:0@lo:101: 00010000:00010000:2.0:1788612380.237523:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af415b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612380.237536:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af415b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612380.237604:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0302680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914317824:0@lo:256: 00000100:00100000:2.0:1788612380.237638:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612380.237668:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612380.244386:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317824 00000100:00100000:1.0:1788612380.244403:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317824 00000100:00100000:1.0:1788612380.244502:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788612380.244516:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914317824:12345-0@lo:256: 20000000:01000000:1.0:1788612380.244549:0:5847:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788612380.244579:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788612380.244584:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788612380.244736:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914317824:12345-0@lo:256: Request processed in 221us (7094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612380.244749:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788612380.252692:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0302680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914317824:0@lo:256: 10000000:01000000:0.0:1788612380.252789:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788612380.252803:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af415b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612380.252813:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af415b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612380.252823:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788612380.252826:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788612380.252828:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788612380.252885:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612380.252894:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612380.252904:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612380.252936:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914317952:0@lo:101: 00000100:00100000:0.0:1788612380.253011:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612380.253098:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914317952 00000100:00100000:0.0:1788612380.253111:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914317952 00000100:00100000:0.0:1788612380.253183:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788612380.253196:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914317952:12345-0@lo:101: 00010000:00010000:0.0:1788612380.253213:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612380.253233:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e910d7e00/0xfc956d548af415be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af415b7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612380.253262:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e910d7e00/0xfc956d548af415be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af415b7 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612380.253272:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e910d7e00/0xfc956d548af415be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af415b7 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612380.253280:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d7e00, rc 0) 00000100:00100000:0.0:1788612380.253311:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914317952:12345-0@lo:101: Request processed in 119us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612380.253318:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788612380.253380:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e910826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612380.253393:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914317952:0@lo:101: 00010000:00010000:0.0:1788612380.253405:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af415be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612380.253413:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af415be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612380.253468:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914318080:0@lo:501: 00000100:00100000:0.0:1788612380.253491:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612380.253510:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318080 00000100:00100000:0.0:1788612380.253519:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318080 00000100:00100000:0.0:1788612380.253541:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788612380.253546:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914318080:12345-0@lo:501: 00000100:00100000:0.0:1788612380.253792:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914318080:12345-0@lo:501: Request processed in 245us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612380.253799:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788612380.253823:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e910826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612380.253833:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914318080:0@lo:501: 00000100:00100000:0.0:1788612380.253877:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914318208:0@lo:503: 00000100:00100000:0.0:1788612380.253913:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612380.253932:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318208 00000100:00100000:0.0:1788612380.253936:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318208 00000100:00100000:0.0:1788612380.253958:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788612380.253964:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914318208:12345-0@lo:503: 00000100:00100000:0.0:1788612380.254332:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914318208:12345-0@lo:503: Request processed in 367us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612380.254340:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788612380.254372:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e910826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612380.254384:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914318208:0@lo:503: 00000100:00100000:2.0:1788612380.262782:0:7000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:7000:1875495914318336:0@lo:502: 00000100:00100000:2.0:1788612380.262894:0:7000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612380.262948:0:7000:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612380.263014:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318336 00000100:00100000:0.0:1788612380.263021:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318336 00000100:00100000:0.0:1788612380.263075:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788612380.263084:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+15:7000:x1875495914318336:12345-0@lo:502: 00000100:00100000:0.0:1788612380.263383:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+15:7000:x1875495914318336:12345-0@lo:502: Request processed in 299us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612380.263391:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788612380.263611:0:7000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:7000:1875495914318336:0@lo:502: 00000020:01000000:2.0:1788612380.263641:0:7000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788612380.263649:0:7000:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788612380.263656:0:7000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612380.263659:0:7000:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788612380.263663:0:7000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788612380.263666:0:7000:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:2.0:1788612380.263688:0:7000:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788612380.263691:0:7000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788612380.263705:0:7000:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff928ec092b380) 00000020:00000080:2.0:1788612380.263727:0:7000:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788612380.263732:0:7000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788612380.263811:0:7000:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788612380.263816:0:7000:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788612380.263823:0:7000:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfc956d548af415cc 00010000:00080000:2.0:1788612380.263885:0:7000:0:(ldlm_lib.c:102:import_set_conn()) imp ffff928ebf87d800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1788612380.264125:0:7000:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:1.0:1788612380.276255:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788612380.348353:0:7000:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788612380.348379:0:7000:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788612380.351742:0:7000:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612380.354477:0:7000:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612380.354536:0:7000:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788612380.354586:0:7000:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788612380.379832:0:7001:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612380.379856:0:7001:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788612380.401885:0:7000:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788612380.401901:0:7000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788612380.401949:0:7000:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788612380.401970:0:7000:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfc956d548af415d3 00000100:00080000:2.0:1788612380.401981:0:7000:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612380.401987:0:7000:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff928ebf87d800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1788612380.402024:0:7000:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928ec0300a80 x1875495914318464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788612380.402068:0:7000:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788612380.402189:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914318464:0@lo:8: 00000100:00100000:0.0:1788612380.402264:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788612380.405936:0:7000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612380.405949:0:7000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612380.405952:0:7000:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788612380.405957:0:7000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612380.405963:0:7000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612380.405965:0:7000:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788612380.405970:0:7000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788612380.405972:0:7000:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788612380.406028:0:7000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0301180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:7000:1875495914318592:0@lo:502: 00000100:00100000:2.0:1788612380.406141:0:7000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612380.406206:0:7000:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cd000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612380.406248:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318592 00000100:00100000:2.0:1788612380.406257:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318592 00000100:00100000:2.0:1788612380.406306:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788612380.406317:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+15:7000:x1875495914318592:12345-0@lo:502: 00000100:00100000:2.0:1788612380.406592:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+15:7000:x1875495914318592:12345-0@lo:502: Request processed in 275us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612380.406600:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788612380.406659:0:7000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0301180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:7000:1875495914318592:0@lo:502: 00000020:01000000:2.0:1788612380.406686:0:7000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612380.406691:0:7000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612380.406692:0:7000:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788612380.406696:0:7000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1788612380.407106:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318464 00000100:00100000:1.0:1788612380.407111:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318464 00000100:00100000:1.0:1788612380.407130:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612380.407143:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875495914318464:12345-0@lo:8: 00010000:00080000:1.0:1788612380.407165:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:1.0:1788612380.407191:0:6695:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfc956d548af415da 00002000:00100000:1.0:1788612380.407229:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff928d8529a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788612380.407234:0:6695:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788612380.407238:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788612380.407349:0:6695:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788612380.407501:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788612380.407529:0:6695:0:(import.c:65:import_set_state_nolock()) ffff928d8529f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612380.407583:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875495914318464:12345-0@lo:8: Request processed in 440us (5319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612380.407590:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1788612380.407609:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788612380.407628:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788612380.407638:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af415be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612380.407648:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af415be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612380.407659:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788612380.407662:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff928e90d3b380 from 1 10000000:01000000:1.0:1788612380.407665:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788612380.407690:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612380.407698:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612380.407719:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612380.407734:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914318976:0@lo:101: 00000100:00100000:1.0:1788612380.407782:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612380.407800:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8396d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612380.407818:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914318720:0@lo:400: 00000100:00100000:1.0:1788612380.407864:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612380.407903:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914318848:0@lo:400: 00000100:00100000:1.0:1788612380.407925:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788612380.407975:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0300a80 x1875495914318464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612380.407985:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788612380.407993:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788612380.408001:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788612380.408006:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788612380.408008:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928ebf87d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788612380.408026:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788612380.408031:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914318464:0@lo:8: 00000100:00100000:1.0:1788612380.408061:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318976 00000100:00100000:1.0:1788612380.408065:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318976 00000100:00100000:1.0:1788612380.408091:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788612380.408098:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914318976:12345-0@lo:101: 00010000:00010000:1.0:1788612380.408108:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612380.408123:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b60000/0xfc956d548af415e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af415e1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612380.408153:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b60000/0xfc956d548af415e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af415e1 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612380.408165:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b60000/0xfc956d548af415e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af415e1 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612380.408176:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60000, rc 0) 00000100:00100000:1.0:1788612380.408204:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914318976:12345-0@lo:101: Request processed in 107us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612380.408209:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788612380.408235:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318720 00000100:00100000:1.0:1788612380.408239:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318720 00000100:00100000:1.0:1788612380.408263:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914318848 00000100:00100000:1.0:1788612380.408265:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914318848 00000100:00100000:1.0:1788612380.408289:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612380.408296:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914318720:12345-0@lo:400: 00000100:00100000:1.0:1788612380.408327:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914318720:12345-0@lo:400: Request processed in 33us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612380.408333:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612380.408344:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612380.408351:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914318848:12345-0@lo:400: 00000100:00100000:1.0:1788612380.408379:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914318848:12345-0@lo:400: Request processed in 29us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612380.408385:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788612380.408408:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788612380.408442:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ebf81f100 x1875495914318848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612380.408465:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914318848:0@lo:400: 00010000:00080000:1.0:1788612380.408490:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ebf81ce00 x1875495914318720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612380.408498:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914318720:0@lo:400: 00000100:00100000:1.0:1788612380.408517:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914318976:0@lo:101: 00010000:00010000:1.0:1788612380.408530:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af415e8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612380.408539:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af415e8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612380.408577:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914319104:0@lo:501: 00000100:00100000:1.0:1788612380.408601:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612380.408615:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8396d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612380.408630:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914319104 00000100:00100000:1.0:1788612380.408633:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914319104 00000100:00100000:1.0:1788612380.408653:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788612380.408659:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914319104:12345-0@lo:501: 00000100:00100000:1.0:1788612380.408863:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914319104:12345-0@lo:501: Request processed in 203us (261us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788612380.408869:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788612380.408898:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914319104:0@lo:501: 10000000:01000000:1.0:1788612380.408914:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788612380.408919:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af415e8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612380.408931:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af415e8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788612380.410004:0:7001:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788612380.410107:0:7001:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 174253268710ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788612380.553276:0:7004:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788612380.553309:0:7004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1875495914319360:0@lo:7: 00000100:00100000:0.0:1788612380.553376:0:7004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612380.553434:0:7004:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91082b40 going to sleep for 11 seconds 00000004:00080000:0.0:1788612380.553452:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788612380.553483:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914319232:0@lo:13: 00000100:00100000:0.0:1788612380.553510:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612380.553554:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914319360 00000100:00100000:0.0:1788612380.553561:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914319360 00000100:00100000:0.0:1788612380.553617:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612380.553627:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7004:x1875495914319360:12345-0@lo:7: 00000100:00080000:1.0:1788612380.564991:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612380.565056:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914319232 00000100:00100000:1.0:1788612380.565072:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914319232 00000100:00100000:1.0:1788612380.565184:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612380.565199:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875495914319232:12345-0@lo:13: 00002000:00000024:1.0:1788612380.565250:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788612380.565355:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875495914319232:12345-0@lo:13: Request processed in 158us (11841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612380.565365:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788612380.574088:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0997800 x1875495914319232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612380.574123:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914319232:0@lo:13: 00002000:00080000:0.0:1788612380.589544:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788612380.589556:0:6698:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788612380.589685:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7004:x1875495914319360:12345-0@lo:7: Request processed in 36052us (36300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612380.589700:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788612380.590229:0:7004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0994380 x1875495914319360/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788612396 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612380.590245:0:7004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1875495914319360:0@lo:7: 00000004:00080000:2.0:1788612380.590270:0:7004:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788612380.590345:0:7004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0301180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1875495914319488:0@lo:5: 00000100:00100000:2.0:1788612380.590384:0:7004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612380.590442:0:7004:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e981313c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612380.590470:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914319488 00000100:00100000:2.0:1788612380.590476:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914319488 00000100:00100000:2.0:1788612380.590523:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612380.590532:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7004:x1875495914319488:12345-0@lo:5: 00002000:00080000:2.0:1788612380.590557:0:6697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788612380.590561:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788612380.590810:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7004:x1875495914319488:12345-0@lo:5: Request processed in 279us (425us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788612380.590817:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788612380.590859:0:7004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0301180 x1875495914319488/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612396 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612380.590871:0:7004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0301180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1875495914319488:0@lo:5: 00000004:00080000:2.0:1788612380.590880:0:7004:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788612380.590904:0:7004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0301500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1875495914319616:0@lo:700: 00000100:00100000:2.0:1788612380.590928:0:7004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612380.590948:0:7004:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e981313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612380.592817:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914319616 00000100:00100000:0.0:1788612380.592829:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914319616 00000100:00100000:0.0:1788612380.592894:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612380.592988:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7004:x1875495914319616:12345-0@lo:700: 00000100:00100000:0.0:1788612380.593102:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0997800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6704:1875495914319744:0@lo:700: 00000100:00100000:0.0:1788612380.593214:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612380.593246:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91082000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612380.593310:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914319744 00000100:00100000:2.0:1788612380.593315:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914319744 00000100:00100000:2.0:1788612380.593350:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612380.593356:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6704:x1875495914319744:12345-0@lo:700: 40000000:02000000:3.0:1788612380.765582:0:5859:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788612380.774048:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6704:x1875495914319744:12345-0@lo:700: Request processed in 180680us (180821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612380.774075:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788612380.775338:0:6704:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0997800 x1875495914319744/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788612396 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612380.775355:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0997800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6704:1875495914319744:0@lo:700: 40000000:02000000:0.0:1788612380.775369:0:6704:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1788612380.970923:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7004:x1875495914319616:12345-0@lo:700: Request processed in 378008us (379980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612380.970939:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788612380.971234:0:7004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0301500 x1875495914319616/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788612396 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612380.971250:0:7004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0301500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1875495914319616:0@lo:700: 00000001:00100000:2.0:1788612380.972507:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788612380.972523:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000004:02000040:1.0:1788612381.075039:0:7004:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788612381.088802:0:7004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1875495914319872:0@lo:5: 00000100:00100000:1.0:1788612381.089143:0:7004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612381.089187:0:7004:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8396d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612381.089524:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914319872 00000100:00100000:0.0:1788612381.089532:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914319872 00000100:00100000:0.0:1788612381.089592:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612381.089601:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7004:x1875495914319872:12345-0@lo:5: 00002000:00080000:2.0:1788612381.122978:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788612381.123000:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00010000:00080000:1.0:1788612381.129901:0:7004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ebf81df80 x1875495914319872/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612397 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612381.129917:0:7004:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788612381.129933:0:7004:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff928ebf81df80 x1875495914319872/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612397 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612381.129946:0:7004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1875495914319872:0@lo:5: 00000004:00080000:1.0:1788612381.129972:0:7004:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000100:00100000:2.0:1788612381.133621:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7004:x1875495914319872:12345-0@lo:5: Request processed in 40218us (40675us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788612381.133639:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788612381.292010:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788612382.055355:0:7064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788612382.339480:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612383.341100:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612384.364323:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612385.389451:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612385.836215:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612385.836241:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914320000:0@lo:13: 00000100:00100000:1.0:1788612385.836306:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612385.836411:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320000 00000100:00100000:0.0:1788612385.836420:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320000 00000100:00100000:0.0:1788612385.836471:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612385.836479:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875495914320000:12345-0@lo:13: 00002000:00000024:0.0:1788612385.836508:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612385.836554:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875495914320000:12345-0@lo:13: Request processed in 76us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612385.836560:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788612385.836577:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788612385.836606:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ebf81f100 x1875495914320000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612385.836636:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914320000:0@lo:13: 00000100:00100000:2.0:1788612385.838169:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914320128:0@lo:400: 00000100:00100000:2.0:1788612385.838222:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612385.838269:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914320256:0@lo:400: 00000100:00100000:2.0:1788612385.838299:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612385.838316:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612385.838321:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914320384:0@lo:400: 00000100:00100000:2.0:1788612385.838342:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612385.838384:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320128 00000100:00100000:2.0:1788612385.838389:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320128 00000100:00100000:2.0:1788612385.838425:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788612385.838433:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:3306:x1875495914320128:12345-0@lo:400: 00000100:00100000:2.0:1788612385.838472:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:3306:x1875495914320128:12345-0@lo:400: Request processed in 40us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612385.838478:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788612385.838521:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320256 00000100:00100000:2.0:1788612385.838525:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320256 00000100:00100000:2.0:1788612385.838552:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320384 00000100:00100000:2.0:1788612385.838555:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320384 00000100:00100000:2.0:1788612385.838579:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788612385.838585:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914320256:12345-0@lo:400: 00000100:00100000:2.0:1788612385.838626:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914320256:12345-0@lo:400: Request processed in 41us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612385.838633:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788612385.838646:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612385.838653:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914320384:12345-0@lo:400: 00000100:00100000:2.0:1788612385.838678:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914320384:12345-0@lo:400: Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612385.838684:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788612385.838708:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788612385.838736:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0300700 x1875495914320384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612385.838749:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914320384:0@lo:400: 00010000:00080000:2.0:1788612385.838758:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0300380 x1875495914320256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612385.838767:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914320256:0@lo:400: 00000100:00100000:2.0:1788612385.838789:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914320128:0@lo:400: 00000001:00080000:3.0:1788612385.916590:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788612386.412069:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612387.443947:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612388.460245:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612389.484470:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612390.515508:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612390.956904:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612390.956939:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914320512:0@lo:13: 00000100:00100000:0.0:1788612390.957010:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612390.957153:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320512 00000100:00100000:1.0:1788612390.957162:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320512 00000100:00100000:1.0:1788612390.957224:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612390.957234:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914320512:12345-0@lo:13: 00002000:00000024:1.0:1788612390.957268:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612390.957326:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914320512:12345-0@lo:13: Request processed in 84us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612390.957333:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788612390.957375:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ebf81d180 x1875495914320512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612390.957386:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788612390.957408:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914320512:0@lo:13: 00000100:00080000:0.0:1788612390.959019:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612390.959271:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612390.959324:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914320640:0@lo:400: 00000100:00100000:2.0:1788612390.959393:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612390.959445:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914320768:0@lo:400: 00000100:00100000:2.0:1788612390.959478:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612390.959501:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612390.959507:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914320896:0@lo:400: 00000100:00100000:2.0:1788612390.959536:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612390.959584:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320768 00000100:00100000:2.0:1788612390.959591:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320768 00000100:00100000:2.0:1788612390.959633:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320896 00000100:00100000:2.0:1788612390.959636:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320896 00000100:00100000:2.0:1788612390.959664:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612390.959671:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914320768:12345-0@lo:400: 00000100:00100000:2.0:1788612390.959727:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914320768:12345-0@lo:400: Request processed in 55us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612390.959733:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612390.959749:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612390.959756:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914320896:12345-0@lo:400: 00000100:00100000:2.0:1788612390.959787:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914320896:12345-0@lo:400: Request processed in 32us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612390.959793:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788612390.959814:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788612390.959855:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0994e00 x1875495914320896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612390.959870:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914320896:0@lo:400: 00010000:00080000:2.0:1788612390.959882:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0997100 x1875495914320768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612390.959891:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914320768:0@lo:400: 00000100:00100000:1.0:1788612390.961073:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914320640 00000100:00100000:1.0:1788612390.961083:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914320640 00000100:00100000:1.0:1788612390.961120:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788612390.961128:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+16:3305:x1875495914320640:12345-0@lo:400: 00000100:00100000:1.0:1788612390.961185:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+16:3305:x1875495914320640:12345-0@lo:400: Request processed in 57us (1791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612390.961191:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788612390.961800:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914320640:0@lo:400: 00010000:00010000:3.0:1788612391.534683:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612392.556595:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788612392.932514:0:7628:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788612392.932518:0:7628:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788612392.932649:0:7628:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff928d85299000 00000020:01000004:1.0:1788612392.932665:0:7628:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788612392.932682:0:7628:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788612392.932695:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff928e91144d40) 00000020:00000080:1.0:1788612392.932711:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788612392.942616:0:7628:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788612392.942790:0:7628:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788612392.952889:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788612392.955532:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788612392.955553:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788612392.955586:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788612392.955600:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788612392.955869:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788612392.955878:0:7628:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788612392.955889:0:7628:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfc956d548af415f6 00000020:01000004:0.0:1788612392.955945:0:7628:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788612392.955964:0:7628:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788612392.955966:0:7628:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788612392.955971:0:7628:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788612392.955985:0:7628:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788612392.955988:0:7628:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788612392.964770:0:7628:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788612392.964799:0:7628:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.106@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788612392.964802:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788612392.964803:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788612392.964804:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612392.964805:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612392.964805:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612392.964806:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612392.964807:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788612392.964808:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788612392.964809:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788612392.964810:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612392.964811:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788612392.964813:0:7628:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788612392.964815:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788612392.964816:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788612392.964816:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612392.964817:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612392.964817:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612392.964818:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612392.964819:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788612392.964819:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788612392.964820:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788612392.964820:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612392.964821:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788612392.964865:0:7628:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788612392.964882:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914321024:0@lo:253: 00000100:00100000:1.0:1788612392.964951:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612392.964999:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e92599600 going to sleep for 11 seconds 00000100:00100000:2.0:1788612392.965008:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321024 00000100:00100000:2.0:1788612392.965015:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321024 00000100:00100000:2.0:1788612392.965067:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788612392.965328:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+16:7628:x1875495914321024:12345-0@lo:253: 20000000:01000000:2.0:1788612392.965373:0:5847:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788612392.965376:0:5847:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788612392.965381:0:5847:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788612392.965384:0:5847:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788612392.966111:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612392.966239:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788612392.966248:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788612392.966269:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788612392.966274:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788612392.966288:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788612392.966328:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788612392.966552:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788612392.966565:0:5847:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.106@tcp 20000000:01000000:2.0:1788612392.966566:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:2.0:1788612392.966584:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788612392.966588:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788612392.966610:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788612392.966614:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:2.0:1788612392.966630:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788612392.966646:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788612392.966663:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788612392.966698:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788612392.967241:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788612392.967250:0:5847:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.106@tcp 20000000:01000000:2.0:1788612392.967251:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.106@tcp (null) (null) (null) 00000040:00080000:2.0:1788612392.967270:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788612392.967274:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788612392.967288:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788612392.967292:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.106@tcp (null) (null) 00000040:00080000:2.0:1788612392.967583:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788612392.967590:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788612392.967623:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788612392.967690:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788612392.967702:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788612392.967704:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788612392.967708:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788612392.967709:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788612392.967711:0:5847:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788612392.967720:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788612392.967722:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788612392.967744:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788612392.967745:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788612392.969048:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788612392.969137:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788612392.969169:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788612392.969638:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788612392.969681:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788612392.969744:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1788612392.969758:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788612392.969760:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788612392.970489:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788612392.970550:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788612392.970605:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788612392.971042:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788612392.971087:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788612392.971123:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788612392.971136:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788612392.971138:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788612392.971562:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788612392.971607:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788612392.971661:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788612392.972045:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788612392.972079:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788612392.972127:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788612392.972138:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788612392.972140:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788612392.972563:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788612392.972768:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788612392.972804:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788612392.973162:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:2.0:1788612392.973181:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788612392.973198:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.973215:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ea0145200/0xfc956d548af4154e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41547 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.973227:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ec21e9e00/0xfc956d548af41578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41571 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.973231:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ec21e8600/0xfc956d548af415a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4159b expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.973235:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e910d7e00/0xfc956d548af415be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af415b7 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.973239:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e90b60000/0xfc956d548af415e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af415e1 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.973243:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.973274:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e90b60000/0xfc956d548af415e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af415e1 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.973285:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e90b60000/0xfc956d548af415e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af415e1 expref: 16 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612392.973307:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875495914321152:0@lo:104: 00000100:00100000:2.0:1788612392.973372:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788612392.973464:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e910d7e00/0xfc956d548af415be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af415b7 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.973472:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e910d7e00/0xfc956d548af415be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af415b7 expref: 16 pid: 5846 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612392.973480:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875495914321280:0@lo:104: 00010000:00010000:2.0:1788612392.973506:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ec21e8600/0xfc956d548af415a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af4159b expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.973511:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928ec21e8600/0xfc956d548af415a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af4159b expref: 16 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612392.973516:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0302680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875495914321408:0@lo:104: 00010000:00010000:2.0:1788612392.973539:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ec21e9e00/0xfc956d548af41578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af41571 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.973544:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928ec21e9e00/0xfc956d548af41578 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af41571 expref: 16 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612392.973549:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875495914321536:0@lo:104: 00010000:00010000:2.0:1788612392.973559:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ea0145200/0xfc956d548af4154e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af41547 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.973563:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928ea0145200/0xfc956d548af4154e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af41547 expref: 16 pid: 5844 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612392.973568:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0303480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875495914321664:0@lo:104: 00000100:00100000:2.0:1788612392.973576:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c253c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612392.973624:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788612392.973639:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612392.973680:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612392.973718:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612392.973730:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321152 00000100:00100000:1.0:1788612392.973736:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321152 00000100:00100000:1.0:1788612392.973763:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321280 00000100:00100000:1.0:1788612392.973764:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321280 00000100:00100000:1.0:1788612392.973770:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321408 00000100:00100000:1.0:1788612392.973771:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321408 00000100:00100000:1.0:1788612392.973778:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612392.973784:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+5:5847:x1875495914321152:12345-0@lo:104: 00010000:00010000:1.0:1788612392.973792:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af415e8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612392.973879:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788612392.973883:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+5:5847:x1875495914321152:12345-0@lo:104: Request processed in 100us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612392.973888:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612392.973924:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788612392.973929:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0997480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+4:5847:x1875495914321280:12345-0@lo:104: 00010000:00010000:1.0:1788612392.973935:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af415be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612392.974000:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875495914321152:0@lo:104: 00000100:00100000:2.0:1788612392.974008:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875495914321280:0@lo:104: 00000100:00100000:0.0:1788612392.974110:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612392.974122:0:5836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788612392.974126:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1788612392.974186:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612392.974192:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af415e8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974197:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788612392.974200:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af415e8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974206:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af415e8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612392.974218:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af415e8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612392.974222:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612392.974247:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af415e8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974251:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612392.974273:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af415e8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974280:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af415e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af415e8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974302:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612392.974305:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af415be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974311:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7c00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788612392.974313:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af415be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974318:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af415be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612392.974322:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af415be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612392.974325:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612392.974340:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af415be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974344:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612392.974348:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af415be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974352:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af415b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af415be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974358:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612392.974359:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612392.974360:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612392.974369:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914321920:0@lo:103: 00000100:00100000:3.0:1788612392.974389:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612392.974408:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612392.974411:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914321792:0@lo:103: 00000100:00100000:3.0:1788612392.974422:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612392.974437:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321920 00000100:00100000:3.0:1788612392.974439:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321920 00010000:00010000:3.0:1788612392.974451:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e910d7e00/0xfc956d548af415be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af415b7 expref: 17 pid: 5846 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612392.974465:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321792 00000100:00100000:3.0:1788612392.974466:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321792 00010000:00010000:3.0:1788612392.974472:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e90b60000/0xfc956d548af415e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af415e1 expref: 18 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612392.974478:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612392.974482:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+18:3306:x1875495914321920:12345-0@lo:103: 00010000:00010000:3.0:1788612392.974494:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612392.974498:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e910d7e00/0xfc956d548af415be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af415b7 expref: 18 pid: 5846 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974504:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e910d7e00/0xfc956d548af415be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af415b7 expref: 18 pid: 5846 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974513:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e910d7e00/0xfc956d548af415be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af415b7 expref: 18 pid: 5846 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974521:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612392.974538:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+17:3306:x1875495914321920:12345-0@lo:103: Request processed in 56us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612392.974543:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612392.974552:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612392.974556:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+16:3306:x1875495914321792:12345-0@lo:103: 00010000:00010000:3.0:1788612392.974560:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612392.974563:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e90b60000/0xfc956d548af415e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af415e1 expref: 16 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974568:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e90b60000/0xfc956d548af415e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af415e1 expref: 16 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974574:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b60000/0xfc956d548af415e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af415e1 expref: 16 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.974579:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612392.974590:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+15:3306:x1875495914321792:12345-0@lo:103: Request processed in 34us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612392.974593:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612392.974618:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914321792:0@lo:103: 00000100:00100000:3.0:1788612392.974622:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914321920:0@lo:103: 00000100:00100000:0.0:1788612392.974780:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321536 00000100:00100000:0.0:1788612392.974783:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321536 00000100:00100000:0.0:1788612392.974795:0:5836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788612392.974798:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914321664 00000100:00100000:0.0:1788612392.974800:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914321664 00000100:00100000:3.0:1788612392.974883:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788612392.974887:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:22c69a0a-d366-4936-9310-01935a424f88+6:5847:x1875495914321408:12345-0@lo:104: 00010000:00010000:3.0:1788612392.974939:0:7634:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af415a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975020:0:7634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788612392.975024:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:22c69a0a-d366-4936-9310-01935a424f88+6:5847:x1875495914321408:12345-0@lo:104: Request processed in 137us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612392.975028:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788612392.975038:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788612392.975042:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0996300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:22c69a0a-d366-4936-9310-01935a424f88+5:5847:x1875495914321536:12345-0@lo:104: 00010000:00010000:3.0:1788612392.975047:0:7634:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41578 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975068:0:7634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788612392.975071:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0996300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:22c69a0a-d366-4936-9310-01935a424f88+5:5847:x1875495914321536:12345-0@lo:104: Request processed in 30us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612392.975075:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788612392.975082:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612392.975085:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af415a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975089:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788612392.975091:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af415a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975103:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af415a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612392.975107:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af415a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612392.975111:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612392.975122:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af415a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975126:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612392.975134:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af415a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975138:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4159b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af415a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975144:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612392.975146:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41578 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975149:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0145400 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788612392.975151:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af41578 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975155:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af41578 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612392.975158:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af41578 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612392.975165:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612392.975173:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41578 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975176:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612392.975180:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41578 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975183:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928ea0145400/0xfc956d548af41571 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41578 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975189:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612392.975190:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612392.975191:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612392.975197:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914322048:0@lo:103: 00000100:00100000:3.0:1788612392.975213:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612392.975229:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612392.975232:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914322176:0@lo:103: 00000100:00100000:3.0:1788612392.975242:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612392.975257:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322048 00000100:00100000:3.0:1788612392.975260:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322048 00010000:00010000:3.0:1788612392.975273:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ec21e8600/0xfc956d548af415a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af4159b expref: 15 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612392.975289:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322176 00000100:00100000:3.0:1788612392.975291:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322176 00010000:00010000:3.0:1788612392.975312:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ec21e9e00/0xfc956d548af41578 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41571 expref: 16 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612392.975334:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788612392.975338:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+16:3307:x1875495914322048:12345-0@lo:103: 00010000:00010000:3.0:1788612392.975343:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612392.975346:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ec21e8600/0xfc956d548af415a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af4159b expref: 16 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975353:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ec21e8600/0xfc956d548af415a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af4159b expref: 16 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975362:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612392.975363:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788612392.975373:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0997480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+4:5847:x1875495914321280:12345-0@lo:104: Request processed in 1441us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612392.975384:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612392.975385:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+16:3307:x1875495914322048:12345-0@lo:103: Request processed in 44us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612392.975389:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788612392.975399:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788612392.975405:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+15:3307:x1875495914322176:12345-0@lo:103: 00010000:00010000:3.0:1788612392.975410:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612392.975414:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ec21e9e00/0xfc956d548af41578 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41571 expref: 15 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612392.975415:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788612392.975424:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ec21e9e00/0xfc956d548af41578 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af41571 expref: 15 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612392.975431:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0997100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+3:5847:x1875495914321664:12345-0@lo:104: 00010000:00010000:3.0:1788612392.975432:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612392.975443:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4154e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612392.975449:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+15:3307:x1875495914322176:12345-0@lo:103: Request processed in 43us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612392.975459:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788612392.975480:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914322176:0@lo:103: 00010000:00010000:1.0:1788612392.975493:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788612392.975494:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914322048:0@lo:103: 00000100:00100000:1.0:1788612392.975504:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0997100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+3:5847:x1875495914321664:12345-0@lo:104: Request processed in 77us (1390us total) trans 0 rc 0/0 00010000:00010000:3.0:1788612392.975510:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788612392.975512:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788612392.975515:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4154e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975520:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7a00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788612392.975522:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af4154e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975528:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af4154e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612392.975532:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af4154e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612392.975535:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612392.975544:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4154e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975548:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612392.975560:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4154e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975565:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41547 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4154e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612392.975571:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914322304:0@lo:103: 00010000:00010000:3.0:1788612392.975574:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612392.975577:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612392.975578:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612392.975593:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612392.975621:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612392.975656:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322304 00000100:00100000:3.0:1788612392.975662:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322304 00010000:00010000:3.0:1788612392.975673:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ea0145200/0xfc956d548af4154e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41547 expref: 15 pid: 5844 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612392.975716:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788612392.975720:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+15:3305:x1875495914322304:12345-0@lo:103: 00010000:00010000:3.0:1788612392.975736:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612392.975739:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ea0145200/0xfc956d548af4154e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41547 expref: 15 pid: 5844 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975744:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ea0145200/0xfc956d548af4154e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af41547 expref: 15 pid: 5844 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975753:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975759:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975767:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975771:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975776:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975780:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975783:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612392.975788:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975793:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975798:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612392.975804:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612392.975826:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+15:3305:x1875495914322304:12345-0@lo:103: Request processed in 106us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612392.975831:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788612392.975864:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914322304:0@lo:103: 00010000:00010000:2.0:1788612392.975908:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e8600/0xfc956d548af415a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af4159b expref: 14 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612392.975916:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0302680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875495914321408:0@lo:104: 00010000:00010000:2.0:1788612392.975929:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e9e00/0xfc956d548af41578 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af41571 expref: 13 pid: 5847 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612392.975935:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875495914321536:0@lo:104: 00010000:00010000:2.0:1788612392.975939:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea0145200/0xfc956d548af4154e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af41547 expref: 12 pid: 5844 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612392.975944:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0303480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875495914321664:0@lo:104: 00010000:00010000:2.0:1788612392.975961:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.975970:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.975977:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612392.975983:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e8000/0xfc956d548af415fd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788612392.975996:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788612393.011378:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+11:7628:x1875495914321024:12345-0@lo:253: Request processed in 46291us (46415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612393.011392:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914321024:0@lo:253: 00000100:00100000:0.0:1788612393.011395:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 10000000:01000000:3.0:1788612393.011410:0:7628:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788612393.011413:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788612393.011415:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788612393.011416:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612393.011417:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788612393.011419:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612393.011420:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612393.011421:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788612393.011423:0:7628:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788612393.011424:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612393.011426:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788612393.011449:0:7628:0:(tgt_mount.c:101:server_register_mount()) register mount ffff928d85299000 from lustre-OST0001 10000000:01000000:3.0:1788612393.011477:0:7628:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788612393.011480:0:7628:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788612393.011489:0:7628:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff928e90d3b380 local copy 10000000:01000000:3.0:1788612393.011493:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788612393.011535:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.011566:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.011576:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612393.011597:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914322432:0@lo:101: 00000100:00100000:3.0:1788612393.011633:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612393.011665:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e98131600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612393.011669:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322432 00000100:00100000:1.0:1788612393.011676:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322432 00000100:00100000:1.0:1788612393.011727:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788612393.011737:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+11:7628:x1875495914322432:12345-0@lo:101: 00010000:00010000:1.0:1788612393.011749:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612393.011762:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b61c00/0xfc956d548af4160b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41604 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612393.011784:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b61c00/0xfc956d548af4160b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41604 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612393.011793:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b61c00/0xfc956d548af4160b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41604 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612393.011801:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61c00, rc 0) 00000100:00100000:1.0:1788612393.011905:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:7628:x1875495914322432:12345-0@lo:101: Request processed in 170us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612393.011918:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788612393.012465:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914322432:0@lo:101: 00010000:00010000:0.0:1788612393.012480:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xfc956d548af4160b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.013038:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfc956d548af4160b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612393.013144:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914322560:0@lo:501: 00000100:00100000:0.0:1788612393.013171:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.013208:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612393.013413:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322560 00000100:00100000:2.0:1788612393.013419:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322560 00000100:00100000:2.0:1788612393.013540:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788612393.013548:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:7628:x1875495914322560:12345-0@lo:501: 00000100:00100000:2.0:1788612393.013870:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:7628:x1875495914322560:12345-0@lo:501: Request processed in 322us (695us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788612393.013878:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788612393.013966:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914322560:0@lo:501: 10000000:01000000:0.0:1788612393.013984:0:7628:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788612393.014012:0:7628:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788612393.014018:0:7628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfc956d548af4160b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.014025:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfc956d548af4160b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.014038:0:7628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfc956d548af4160b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.014055:0:7628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788612393.014071:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff928d85299000 10000000:01000000:0.0:1788612393.014074:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788612393.014078:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788612393.014080:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788612393.014083:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788612393.014085:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788612393.014101:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.014106:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.014112:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612393.014120:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914322688:0@lo:101: 00000100:00100000:0.0:1788612393.014141:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.014168:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612393.014193:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322688 00000100:00100000:1.0:1788612393.014197:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322688 00010000:00010000:3.0:1788612393.014222:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788612393.014227:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00010000:00010000:3.0:1788612393.014229:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xfc956d548af4160b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612393.014235:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:7628:x1875495914322688:12345-0@lo:101: 00010000:00010000:3.0:1788612393.014236:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030400 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788612393.014240:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xfc956d548af4160b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612393.014242:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612393.014247:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xfc956d548af4160b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612393.014253:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b61e00/0xfc956d548af41619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41612 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612393.014255:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xfc956d548af4160b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612393.014260:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788612393.014271:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b61e00/0xfc956d548af41619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41612 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.014277:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfc956d548af4160b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612393.014280:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b61e00/0xfc956d548af41619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41612 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.014283:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612393.014288:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61e00, rc 0) 00010000:00010000:3.0:1788612393.014329:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfc956d548af4160b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612393.014329:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:7628:x1875495914322688:12345-0@lo:101: Request processed in 95us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612393.014335:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:3.0:1788612393.014342:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e80030400/0xfc956d548af41604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfc956d548af4160b expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.014355:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612393.014357:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612393.014358:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612393.014365:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612393.014376:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914322816:0@lo:103: 00000100:00100000:3.0:1788612393.014412:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.014490:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914322688:0@lo:101: 00010000:00010000:0.0:1788612393.014501:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41619 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.014509:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41619 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612393.014542:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322816 00000100:00100000:1.0:1788612393.014546:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322816 00000100:00100000:0.0:1788612393.014572:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914322944:0@lo:501: 00000100:00100000:1.0:1788612393.014580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612393.014586:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+13:3305:x1875495914322816:12345-0@lo:103: 00000100:00100000:0.0:1788612393.014594:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612393.014595:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612393.014607:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b61c00/0xfc956d548af4160b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af41604 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612393.014616:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612393.014616:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612393.014717:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+12:3305:x1875495914322816:12345-0@lo:103: Request processed in 131us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612393.014718:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914322944 00000100:00100000:1.0:1788612393.014724:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788612393.014727:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914322944 00000100:00100000:2.0:1788612393.014750:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788612393.014756:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:7628:x1875495914322944:12345-0@lo:501: 00000100:00100000:0.0:1788612393.016377:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914322816:0@lo:103: 00000100:00100000:1.0:1788612393.016523:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914322944:0@lo:501: 00000100:00100000:1.0:1788612393.016564:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323072:0@lo:503: 00000100:00100000:1.0:1788612393.016622:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612393.016707:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:7628:x1875495914322944:12345-0@lo:501: Request processed in 1950us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612393.016717:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788612393.016765:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e87106480 going to sleep for 11 seconds 00000100:00100000:2.0:1788612393.016812:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323072 00000100:00100000:2.0:1788612393.016818:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323072 00000100:00100000:2.0:1788612393.016914:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788612393.016922:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:7628:x1875495914323072:12345-0@lo:503: 00000100:00100000:2.0:1788612393.017230:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+12:7628:x1875495914323072:12345-0@lo:503: Request processed in 308us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612393.017236:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788612393.017313:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323072:0@lo:503: 00000040:00080000:0.0:1788612393.017565:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788612393.017628:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323200:0@lo:502: 00000100:00100000:0.0:1788612393.017673:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.018007:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612393.018045:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323200 00000100:00100000:1.0:1788612393.018050:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323200 00000100:00100000:1.0:1788612393.018071:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788612393.018077:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:7628:x1875495914323200:12345-0@lo:502: 00000100:00100000:1.0:1788612393.018273:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:7628:x1875495914323200:12345-0@lo:502: Request processed in 194us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612393.018280:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788612393.018360:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323200:0@lo:502: 00000040:00080000:0.0:1788612393.018604:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788612393.018663:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788612393.018695:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788612393.018751:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788612393.018787:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788612393.018816:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788612393.018872:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323328:0@lo:502: 00000100:00100000:0.0:1788612393.018917:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.018934:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612393.019090:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323328 00000100:00100000:1.0:1788612393.019095:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323328 00000100:00100000:1.0:1788612393.019116:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788612393.019122:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:7628:x1875495914323328:12345-0@lo:502: 00000100:00100000:1.0:1788612393.019261:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:7628:x1875495914323328:12345-0@lo:502: Request processed in 138us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612393.019269:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788612393.019355:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323328:0@lo:502: 00000040:00080000:0.0:1788612393.019427:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788612393.019436:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788612393.021810:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788612393.021821:0:7635:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788612393.021829:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612393.022036:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788612393.022042:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788612393.022055:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff928e90d38000) 00000020:00000080:0.0:1788612393.022075:0:7635:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788612393.022078:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788612393.022122:0:7635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff928d85299000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788612393.022127:0:7635:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788612393.022132:0:7635:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfc956d548af41627 00010000:00010000:0.0:1788612393.025826:0:7635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788612393.026673:0:7635:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788612393.029218:0:7635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788612393.029491:0:7635:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788612393.033709:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788612393.035018:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788612393.040412:0:7635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788612393.040426:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612393.040432:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612393.040434:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788612393.040438:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612393.040442:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612393.040444:0:7635:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788612393.040453:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788612393.040455:0:7635:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788612393.040508:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612393.040511:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612393.040513:0:7635:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788612393.040516:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788612393.041121:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788612393.041148:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788612393.041165:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41619 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.041177:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41619 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612393.041186:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928d85299000 from 1 10000000:01000000:0.0:1788612393.041188:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612393.041222:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.041230:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.041241:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612393.041269:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323456:0@lo:101: 00000100:00100000:0.0:1788612393.041348:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.041394:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612393.041507:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323456 00000100:00100000:3.0:1788612393.041515:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323456 00000100:00100000:3.0:1788612393.041564:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788612393.041573:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+12:7628:x1875495914323456:12345-0@lo:101: 00010000:00010000:3.0:1788612393.041586:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612393.041598:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e80030400/0xfc956d548af41635 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af4162e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.041621:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e80030400/0xfc956d548af41635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af4162e expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.041631:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e80030400/0xfc956d548af41635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4162e expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.041650:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030400, rc 0) 00000100:00100000:3.0:1788612393.041686:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:7628:x1875495914323456:12345-0@lo:101: Request processed in 114us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612393.041692:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788612393.041869:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323456:0@lo:101: 00010000:00010000:0.0:1788612393.041883:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41635 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.041902:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41635 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612393.042100:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323584:0@lo:501: 00000100:00100000:0.0:1788612393.042125:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.042149:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612393.042216:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323584 00000100:00100000:3.0:1788612393.042226:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323584 00000100:00100000:3.0:1788612393.042248:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788612393.042254:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:7628:x1875495914323584:12345-0@lo:501: 00000100:00100000:3.0:1788612393.042466:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:7628:x1875495914323584:12345-0@lo:501: Request processed in 211us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612393.042473:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788612393.044097:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323584:0@lo:501: 00000100:00100000:0.0:1788612393.044142:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323712:0@lo:503: 00000100:00100000:0.0:1788612393.044197:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.044231:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612393.045498:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323712 00000100:00100000:2.0:1788612393.045507:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323712 00000100:00100000:2.0:1788612393.045557:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788612393.045566:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:7628:x1875495914323712:12345-0@lo:503: 00000100:00100000:2.0:1788612393.045943:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:7628:x1875495914323712:12345-0@lo:503: Request processed in 378us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612393.045951:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788612393.046054:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323712:0@lo:503: 00000040:00080000:0.0:1788612393.046343:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788612393.046416:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323840:0@lo:502: 00000100:00100000:0.0:1788612393.046456:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.046491:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612393.050419:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323840 00000100:00100000:2.0:1788612393.050438:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323840 00000100:00100000:2.0:1788612393.050504:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788612393.050514:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:7628:x1875495914323840:12345-0@lo:502: 00000100:00100000:2.0:1788612393.050799:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:7628:x1875495914323840:12345-0@lo:502: Request processed in 286us (4342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612393.050807:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788612393.051030:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323840:0@lo:502: 00000040:00080000:0.0:1788612393.051329:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788612393.051386:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788612393.051417:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323968:0@lo:502: 00000100:00100000:0.0:1788612393.051458:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.051492:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612393.052209:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914323968 00000100:00100000:2.0:1788612393.052216:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914323968 00000100:00100000:2.0:1788612393.052251:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788612393.052258:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:7628:x1875495914323968:12345-0@lo:502: 00000100:00100000:2.0:1788612393.052420:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:7628:x1875495914323968:12345-0@lo:502: Request processed in 161us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612393.052427:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788612393.052532:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914323968:0@lo:502: 00000040:00080000:0.0:1788612393.052617:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788612393.052629:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788612393.053373:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612393.053383:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612393.053386:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788612393.053392:0:7639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff928d85299000 00000020:00000080:0.0:1788612393.053394:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788612393.053409:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612393.053412:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612393.053414:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788612393.053416:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788612393.053526:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788612393.053543:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612393.053562:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41635 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612393.053574:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41635 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612393.053614:0:7628:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788612393.053617:0:7628:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff928d85299000 10000000:01000000:2.0:1788612393.053620:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff928d85299000 10000000:01000000:2.0:1788612393.053625:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788612393.053630:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff928d85299000 from 1 10000000:01000000:2.0:1788612393.053633:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788612393.053660:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612393.053668:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612393.053678:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612393.053696:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0303480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914324096:0@lo:101: 00000100:00100000:2.0:1788612393.053745:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612393.053778:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c25d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612393.053932:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324096 00000100:00100000:0.0:1788612393.053938:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324096 00000100:00100000:0.0:1788612393.053967:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788612393.053975:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+13:7628:x1875495914324096:12345-0@lo:101: 00010000:00010000:0.0:1788612393.053985:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612393.053997:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e910d7e00/0xfc956d548af41643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af4163c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.054019:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e910d7e00/0xfc956d548af41643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af4163c expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.054031:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e910d7e00/0xfc956d548af41643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4163c expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.054054:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d7e00, rc 0) 00000100:00100000:0.0:1788612393.054096:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+14:7628:x1875495914324096:12345-0@lo:101: Request processed in 122us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612393.054103:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788612393.054168:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0303480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914324096:0@lo:101: 00010000:00010000:3.0:1788612393.054181:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41643 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.054191:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41643 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612393.054259:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914324224:0@lo:501: 00000100:00100000:3.0:1788612393.054286:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612393.054327:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e86276f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612393.054367:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324224 00000100:00100000:1.0:1788612393.054372:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324224 00000100:00100000:1.0:1788612393.054400:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788612393.054407:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+14:7628:x1875495914324224:12345-0@lo:501: 00000100:00100000:1.0:1788612393.054597:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+14:7628:x1875495914324224:12345-0@lo:501: Request processed in 189us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612393.054604:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788612393.054684:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914324224:0@lo:501: 00000100:00100000:3.0:1788612393.054710:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914324352:0@lo:503: 00000100:00100000:3.0:1788612393.054743:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612393.054762:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e86276f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612393.054797:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324352 00000100:00100000:1.0:1788612393.054801:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324352 00000100:00100000:1.0:1788612393.054826:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788612393.054832:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+14:7628:x1875495914324352:12345-0@lo:503: 00000100:00100000:1.0:1788612393.054980:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+14:7628:x1875495914324352:12345-0@lo:503: Request processed in 147us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612393.054987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788612393.055098:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914324352:0@lo:503: 00000040:00080000:3.0:1788612393.055379:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788612393.055432:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914324480:0@lo:502: 00000100:00100000:3.0:1788612393.055465:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612393.055523:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e86276f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612393.055552:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324480 00000100:00100000:1.0:1788612393.055556:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324480 00000100:00100000:1.0:1788612393.055608:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788612393.055615:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+14:7628:x1875495914324480:12345-0@lo:502: 00000100:00100000:1.0:1788612393.055765:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+14:7628:x1875495914324480:12345-0@lo:502: Request processed in 150us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612393.055772:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788612393.055828:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914324480:0@lo:502: 00000040:00080000:3.0:1788612393.056045:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788612393.056085:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788612393.056113:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788612393.056154:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788612393.056185:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788612393.056228:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788612393.056264:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788612393.056303:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788612393.056364:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788612393.056400:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788612393.056430:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788612393.056473:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788612393.056506:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788612393.056533:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788612393.056572:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788612393.056601:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788612393.056628:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788612393.056669:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788612393.056704:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788612393.056736:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788612393.056777:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788612393.056807:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788612393.056873:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788612393.056922:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788612393.056957:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788612393.056991:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788612393.057043:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788612393.057080:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788612393.057112:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788612393.057156:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788612393.057186:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788612393.057215:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788612393.057252:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788612393.057291:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788612393.057353:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788612393.057395:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788612393.057426:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788612393.057455:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914324608:0@lo:502: 00000100:00100000:3.0:1788612393.057504:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612393.057743:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e86276f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612393.057812:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324608 00000100:00100000:0.0:1788612393.057819:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324608 00000100:00100000:0.0:1788612393.057915:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788612393.057923:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+14:7628:x1875495914324608:12345-0@lo:502: 00000100:00100000:0.0:1788612393.058147:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+14:7628:x1875495914324608:12345-0@lo:502: Request processed in 224us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612393.058154:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788612393.058376:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914324608:0@lo:502: 00000040:00080000:3.0:1788612393.058444:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788612393.058454:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788612393.058906:0:7640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788612393.058932:0:7640:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff928d8583b380) 00000020:00000080:0.0:1788612393.058953:0:7640:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788612393.059030:0:7640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff928d85299000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788612393.059035:0:7640:0:(tgt_mount.c:187:server_put_mount()) put mount ffff928d85299000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788612393.059037:0:7640:0:(obd_mount.c:710:lustre_put_lsi()) put ffff928d85299000 3 00010000:00080000:0.0:1788612393.059063:0:7640:0:(ldlm_lib.c:102:import_set_conn()) imp ffff928d8524b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.106@tcp at head 00010000:00010000:0.0:1788612393.060593:0:7640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788612393.060788:0:7640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788612393.060818:0:7640:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788612393.060829:0:7640:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xfc956d548af41651 00000100:00080000:0.0:1788612393.060860:0:7640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788612393.060867:0:7640:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff928d8524b800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1788612393.060900:0:7640:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928ec0994380 x1875495914324736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612393.060922:0:7640:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788612393.061037:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914324864:0@lo:400: 00000100:00100000:0.0:1788612393.061100:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.061139:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612393.061145:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914324992:0@lo:400: 00000100:00100000:0.0:1788612393.061166:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.061192:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914325120:0@lo:400: 00000100:00100000:0.0:1788612393.061216:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.061247:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324864 00000100:00100000:0.0:1788612393.061253:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324864 00000100:00100000:0.0:1788612393.061291:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324992 00000100:00100000:0.0:1788612393.061305:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324992 00000100:00100000:0.0:1788612393.061335:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612393.061345:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914324864:12345-0@lo:400: 00000100:00100000:0.0:1788612393.061397:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914324864:12345-0@lo:400: Request processed in 54us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612393.061404:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612393.061417:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612393.061423:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914324992:12345-0@lo:400: 00000100:00100000:0.0:1788612393.061444:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914324992:12345-0@lo:400: Request processed in 22us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612393.061450:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612393.061469:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914325120 00000100:00100000:0.0:1788612393.061472:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914325120 00000100:00100000:0.0:1788612393.061496:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612393.061502:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0995f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914325120:12345-0@lo:400: 00000100:00100000:0.0:1788612393.061530:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0995f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914325120:12345-0@lo:400: Request processed in 29us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612393.061545:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788612393.061563:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788612393.061567:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788612393.061593:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0995180 x1875495914325120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612393.061605:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914325120:0@lo:400: 00010000:00080000:0.0:1788612393.061629:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0996a00 x1875495914324992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612393.061637:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914324992:0@lo:400: 00010000:00080000:0.0:1788612393.061646:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0995500 x1875495914324864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612393.061654:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914324864:0@lo:400: 00000100:00100000:1.0:1788612393.061834:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875495914324736:0@lo:38: 00000100:00100000:1.0:1788612393.061892:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.066083:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914324736 00000100:00100000:0.0:1788612393.066096:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914324736 00000100:00100000:0.0:1788612393.066141:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612393.066150:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875495914324736:12345-0@lo:38: 00010000:00080000:0.0:1788612393.066178:0:5854:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:0.0:1788612393.066213:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xfc956d548af41658 00000004:00100000:0.0:1788612393.066229:0:5854:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788612393.066277:0:5854:0:(import.c:65:import_set_state_nolock()) ffff928d8524c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612393.066374:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875495914324736:12345-0@lo:38: Request processed in 224us (4480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612393.066382:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788612393.066429:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0994380 x1875495914324736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612393.066449:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612393.066457:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788612393.066465:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788612393.066469:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788612393.066471:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928d8524b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788612393.066477:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875495914324736:0@lo:38: 00000100:00100000:0.0:1788612393.066587:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7641:1875495914325248:0@lo:901: 00000100:00100000:0.0:1788612393.066631:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.066650:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e9022f780 going to sleep for 11 seconds 00000040:00080000:0.0:1788612393.066748:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1788612393.067862:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914325248 00000100:00100000:3.0:1788612393.067868:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914325248 00000100:00100000:3.0:1788612393.067916:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612393.067923:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7641:x1875495914325248:12345-0@lo:901: 00000100:00100000:3.0:1788612393.068271:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7641:x1875495914325248:12345-0@lo:901: Request processed in 347us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612393.068279:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:3.0:1788612393.068314:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788612393.068351:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788612393.068369:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41643 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.068385:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41643 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788612393.068443:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788612393.068445:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788612393.068447:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612393.068451:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612393.068453:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612393.068455:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612393.068457:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788612393.068459:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788612393.068460:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788612393.068462:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612393.068464:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788612393.068467:0:7628:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788612393.068470:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788612393.068472:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788612393.068473:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612393.068474:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612393.068475:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612393.068477:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612393.068478:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788612393.068479:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788612393.068482:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00010000:00080000:0.0:1788612393.068483:0:7641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928ec0994380 x1875495914325248/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788612409 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000004:3.0:1788612393.068484:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612393.068486:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788612393.068497:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7641:1875495914325248:0@lo:901: 10000000:01000000:3.0:1788612393.068505:0:7628:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788612393.068518:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914325376:0@lo:253: 00000100:00100000:3.0:1788612393.068568:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612393.068605:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90aae240 going to sleep for 11 seconds 00000100:00080000:2.0:1788612393.068658:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612393.068713:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914325376 00000100:00100000:1.0:1788612393.068718:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914325376 00000100:00100000:1.0:1788612393.068752:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788612393.068761:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+14:7628:x1875495914325376:12345-0@lo:253: 20000000:01000000:1.0:1788612393.068783:0:5846:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788612393.068797:0:5846:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788612393.081241:0:5846:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788612393.081260:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788612393.081351:0:5868:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788612393.081356:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788612393.081377:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612393.081405:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e90b60200/0xfc956d548af415b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af415a9 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612393.081413:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612393.081456:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e90b60200/0xfc956d548af415b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af415a9 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612393.081469:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e90b60200/0xfc956d548af415b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af415a9 expref: 14 pid: 5844 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612393.081482:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1875495914325504:0@lo:104: 00000100:00100000:2.0:1788612393.081545:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612393.081587:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c25c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612393.081732:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914325504 00000100:00100000:0.0:1788612393.081739:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914325504 00000100:00100000:0.0:1788612393.081786:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612393.081795:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0302680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+3:5868:x1875495914325504:12345-0@lo:104: 00010000:00010000:0.0:1788612393.081815:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af415b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.081882:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788612393.081888:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0302680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+3:5868:x1875495914325504:12345-0@lo:104: Request processed in 95us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612393.081895:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788612393.081927:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612393.081934:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af415b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.081942:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788612393.081946:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af415b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.081955:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af415b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612393.081962:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af415b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612393.081968:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612393.081994:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af415b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.082000:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612393.082014:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af415b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.082020:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af415a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af415b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.082034:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612393.082035:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612393.082037:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612393.082047:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914325632:0@lo:103: 00000100:00100000:0.0:1788612393.082075:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612393.082118:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1875495914325504:0@lo:104: 00010000:00010000:0.0:1788612393.082141:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612393.082738:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914325632 00000100:00100000:3.0:1788612393.082744:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914325632 00010000:00010000:3.0:1788612393.082763:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e90b60200/0xfc956d548af415b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af415a9 expref: 15 pid: 5844 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612393.083336:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788612393.083346:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9238c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+15:3306:x1875495914325632:12345-0@lo:103: 00010000:00010000:3.0:1788612393.083358:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612393.083364:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e90b60200/0xfc956d548af415b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af415a9 expref: 15 pid: 5844 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.083375:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e90b60200/0xfc956d548af415b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af415a9 expref: 15 pid: 5844 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.083506:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b60200/0xfc956d548af415b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af415a9 expref: 15 pid: 5844 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.083520:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.083528:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788612393.083543:0:5839:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002187769s 00010000:00010000:3.0:1788612393.083547:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.083555:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.083562:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.083570:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.083576:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9e00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612393.083580:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.083588:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.085354:0:5868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612393.085372:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.085486:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.085510:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e9e00/0xfc956d548af4165f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612393.085526:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612393.085593:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9238c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+14:3306:x1875495914325632:12345-0@lo:103: Request processed in 2246us (3514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612393.085602:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612393.085620:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914325632:0@lo:103: 00000100:00100000:0.0:1788612393.087625:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+13:7628:x1875495914325376:12345-0@lo:253: Request processed in 18860us (19051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612393.087643:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22c69a0a-d366-4936-9310-01935a424f88:7628:1875495914325376:0@lo:253: 00000100:00100000:0.0:1788612393.087647:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 10000000:01000000:3.0:1788612393.087656:0:7628:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788612393.087658:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788612393.087660:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788612393.087661:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612393.087663:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612393.087664:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612393.087665:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612393.087667:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788612393.087668:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788612393.087670:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788612393.087671:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612393.087672:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788612393.087685:0:7628:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788612393.090571:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788612393.090721:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788612393.091044:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788612393.091144:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788612393.091253:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788612393.091502:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788612393.092174:0:7628:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788612393.322476:0:7628:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788612393.322485:0:7628:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788612393.322517:0:7628:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788612393.322574:0:7628:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788612393.322587:0:7628:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788612393.322611:0:7628:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788612393.581802:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612394.604787:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612395.628289:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612396.088238:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914325760:0@lo:13: 00000100:00100000:1.0:1788612396.088318:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612396.088474:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914325760 00000100:00100000:2.0:1788612396.088491:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914325760 00000100:00100000:2.0:1788612396.088557:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612396.088567:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914325760:12345-0@lo:13: 00002000:00000024:2.0:1788612396.088601:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612396.088660:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914325760:12345-0@lo:13: Request processed in 94us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612396.088682:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788612396.088792:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788612396.088890:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef6d80 x1875495914325760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612396.088907:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914325760:0@lo:13: 00010000:00010000:1.0:1788612396.652172:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612397.677465:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612398.125282:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914325888:0@lo:400: 00000100:00100000:0.0:1788612398.125533:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914326016:0@lo:400: 00000100:00100000:0.0:1788612398.125563:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612398.125602:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326016 00000100:00100000:1.0:1788612398.125609:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326016 00000100:00100000:0.0:1788612398.125614:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612398.125619:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914326144:0@lo:400: 00000100:00100000:0.0:1788612398.125640:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612398.125649:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326144 00000100:00100000:1.0:1788612398.125652:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326144 00000100:00100000:1.0:1788612398.125677:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612398.125686:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914326016:12345-0@lo:400: 00000100:00100000:1.0:1788612398.125753:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914326016:12345-0@lo:400: Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612398.125760:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612398.125776:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788612398.125782:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914326144:12345-0@lo:400: 00000100:00100000:1.0:1788612398.125808:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914326144:12345-0@lo:400: Request processed in 28us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612398.125814:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788612398.126070:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788612398.126099:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef4000 x1875495914326144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612398.126115:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914326144:0@lo:400: 00010000:00080000:1.0:1788612398.126126:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef4a80 x1875495914326016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612398.126133:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914326016:0@lo:400: 00000100:00100000:3.0:1788612398.126228:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612398.126266:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914326400:0@lo:400: 00000100:00100000:1.0:1788612398.126275:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914325888 00000100:00100000:1.0:1788612398.126279:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914325888 00000100:00100000:3.0:1788612398.126295:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612398.126306:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788612398.126310:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612398.126312:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:3308:x1875495914325888:12345-0@lo:400: 00000100:00100000:3.0:1788612398.126315:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914326272:0@lo:400: 00000100:00100000:3.0:1788612398.126338:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612398.126341:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:3308:x1875495914325888:12345-0@lo:400: Request processed in 30us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612398.126347:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788612398.126370:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326400 00000100:00100000:1.0:1788612398.126374:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326400 00000100:00100000:1.0:1788612398.126401:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788612398.126407:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914326400:12345-0@lo:400: 00000100:00100000:1.0:1788612398.126434:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914326400:12345-0@lo:400: Request processed in 27us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612398.126440:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788612398.126453:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612398.126753:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914325888:0@lo:400: 00010000:00080000:3.0:1788612398.126763:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef5880 x1875495914326400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612398.126773:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914326400:0@lo:400: 00000100:00100000:3.0:1788612398.126802:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326272 00000100:00100000:3.0:1788612398.126805:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326272 00000100:00100000:3.0:1788612398.126851:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612398.126859:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914326272:12345-0@lo:400: 00000100:00100000:3.0:1788612398.126896:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914326272:12345-0@lo:400: Request processed in 38us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612398.126902:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788612398.126919:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788612398.128223:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef7100 x1875495914326272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612398.128236:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914326272:0@lo:400: 00000001:02000400:3.0:1788612398.458368:0:7983:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788612398.700197:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612399.727437:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612400.750144:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612401.209288:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612401.209309:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914326528:0@lo:13: 00000100:00100000:2.0:1788612401.209372:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612401.209463:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326528 00000100:00100000:3.0:1788612401.209470:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326528 00000100:00100000:3.0:1788612401.209528:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612401.209553:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0300a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914326528:12345-0@lo:13: 00002000:00000024:3.0:1788612401.209758:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612401.209801:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0300a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914326528:12345-0@lo:13: Request processed in 259us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.209808:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788612401.210304:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788612401.210337:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef7100 x1875495914326528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612401.210355:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914326528:0@lo:13: 10000000:01000000:3.0:1788612401.707912:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788612401.707920:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff928e9162f000 from 30 10000000:01000000:3.0:1788612401.707926:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788612401.707971:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.707982:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.707992:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612401.708016:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914326656:0@lo:101: 00000100:00100000:3.0:1788612401.708084:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612401.708132:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e922f93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612401.708157:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326656 00000100:00100000:3.0:1788612401.708163:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326656 00000100:00100000:3.0:1788612401.708226:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788612401.708235:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+13:5849:x1875495914326656:12345-0@lo:101: 00010000:00010000:3.0:1788612401.708247:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612401.708259:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e80030c00/0xfc956d548af4166d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41666 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.708283:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e80030c00/0xfc956d548af4166d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41666 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.708303:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e80030c00/0xfc956d548af4166d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41666 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.708313:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030c00, rc 0) 00000100:00100000:3.0:1788612401.708350:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914326656:12345-0@lo:101: Request processed in 116us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.708357:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788612401.708405:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914326656:0@lo:101: 00010000:00010000:3.0:1788612401.708420:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4166d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.708429:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4166d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612401.708479:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914326784:0@lo:501: 00000100:00100000:3.0:1788612401.708503:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612401.708516:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e922f93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612401.708528:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326784 00000100:00100000:3.0:1788612401.708531:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326784 00000100:00100000:3.0:1788612401.708552:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788612401.708558:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914326784:12345-0@lo:501: 00000100:00100000:3.0:1788612401.708917:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914326784:12345-0@lo:501: Request processed in 358us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.708925:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788612401.708958:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914326784:0@lo:501: 00000100:00100000:3.0:1788612401.708987:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914326912:0@lo:503: 00000100:00100000:3.0:1788612401.709031:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612401.709044:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e922f93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612401.709056:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914326912 00000100:00100000:3.0:1788612401.709060:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914326912 00000100:00100000:3.0:1788612401.709081:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788612401.709087:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914326912:12345-0@lo:503: 00000100:00100000:3.0:1788612401.709367:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914326912:12345-0@lo:503: Request processed in 280us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.709375:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788612401.709414:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914326912:0@lo:503: 00000100:00100000:2.0:1788612401.713569:0:8106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8106:1875495914327040:0@lo:502: 00000100:00100000:2.0:1788612401.713670:0:8106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.713711:0:8106:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90a04600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612401.714006:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327040 00000100:00100000:3.0:1788612401.714015:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327040 00000100:00100000:3.0:1788612401.714060:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788612401.714069:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+14:8106:x1875495914327040:12345-0@lo:502: 00000100:00100000:3.0:1788612401.714396:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+14:8106:x1875495914327040:12345-0@lo:502: Request processed in 328us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.714404:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788612401.714537:0:8106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8106:1875495914327040:0@lo:502: 00000100:00100000:2.0:1788612401.714600:0:8106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8106:1875495914327168:0@lo:502: 00000100:00100000:2.0:1788612401.714645:0:8106:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.714665:0:8106:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e910e79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612401.714947:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327168 00000100:00100000:3.0:1788612401.714952:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327168 00000100:00100000:3.0:1788612401.714989:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788612401.714997:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+14:8106:x1875495914327168:12345-0@lo:502: 00000100:00100000:3.0:1788612401.715144:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+14:8106:x1875495914327168:12345-0@lo:502: Request processed in 148us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.715152:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788612401.717126:0:8106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8106:1875495914327168:0@lo:502: 00000040:00080000:2.0:1788612401.717171:0:8106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788612401.720883:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788612401.720920:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788612401.720930:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4166d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.720952:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4166d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612401.720962:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788612401.720964:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788612401.720967:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788612401.720998:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.721006:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.721016:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612401.721037:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914327296:0@lo:101: 00000100:00100000:0.0:1788612401.721095:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.721143:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612401.721271:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327296 00000100:00100000:3.0:1788612401.721279:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327296 00000100:00100000:3.0:1788612401.721330:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788612401.721346:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914327296:12345-0@lo:101: 00010000:00010000:3.0:1788612401.721359:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612401.721372:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e80030000/0xfc956d548af4167b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41674 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.721393:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e80030000/0xfc956d548af4167b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41674 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.721403:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e80030000/0xfc956d548af4167b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41674 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612401.721411:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030000, rc 0) 00000100:00100000:3.0:1788612401.721449:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914327296:12345-0@lo:101: Request processed in 104us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.721456:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788612401.721652:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914327296:0@lo:101: 00010000:00010000:0.0:1788612401.721666:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4167b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.721675:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4167b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612401.721720:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914327424:0@lo:501: 00000100:00100000:0.0:1788612401.721744:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.721781:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612401.721931:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327424 00000100:00100000:3.0:1788612401.721936:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327424 00000100:00100000:3.0:1788612401.721964:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788612401.721971:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914327424:12345-0@lo:501: 00000100:00100000:3.0:1788612401.722179:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914327424:12345-0@lo:501: Request processed in 208us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.722185:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788612401.722697:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914327424:0@lo:501: 00000100:00100000:0.0:1788612401.722728:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914327552:0@lo:503: 00000100:00100000:0.0:1788612401.722770:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.722790:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612401.722973:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327552 00000100:00100000:3.0:1788612401.722978:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327552 00000100:00100000:3.0:1788612401.723012:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788612401.723020:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914327552:12345-0@lo:503: 00000100:00100000:3.0:1788612401.723324:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914327552:12345-0@lo:503: Request processed in 304us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.723340:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788612401.723653:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914327552:0@lo:503: 00000100:00100000:0.0:1788612401.734244:0:8108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8108:1875495914327680:0@lo:502: 00000100:00100000:0.0:1788612401.734330:0:8108:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.734376:0:8108:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.734427:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327680 00000100:00100000:1.0:1788612401.734435:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327680 00000100:00100000:1.0:1788612401.734493:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788612401.734503:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+15:8108:x1875495914327680:12345-0@lo:502: 00000100:00100000:1.0:1788612401.734788:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+15:8108:x1875495914327680:12345-0@lo:502: Request processed in 286us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.734796:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788612401.735063:0:8108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8108:1875495914327680:0@lo:502: 00000020:01000000:2.0:1788612401.735091:0:8108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612401.735102:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612401.735105:0:8108:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788612401.735110:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788612401.735112:0:8108:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788612401.735133:0:8108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8108:1875495914327808:0@lo:502: 00000100:00100000:2.0:1788612401.735172:0:8108:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.735222:0:8108:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90a04600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.735331:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327808 00000100:00100000:1.0:1788612401.735336:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327808 00000100:00100000:1.0:1788612401.735373:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788612401.735382:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+15:8108:x1875495914327808:12345-0@lo:502: 00000100:00100000:1.0:1788612401.735516:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+15:8108:x1875495914327808:12345-0@lo:502: Request processed in 135us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.735523:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788612401.735722:0:8108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8108:1875495914327808:0@lo:502: 00000020:01000000:2.0:1788612401.735742:0:8108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612401.735746:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612401.735748:0:8108:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788612401.735751:0:8108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788612401.735903:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788612401.735919:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788612401.735929:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4167b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.735940:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4167b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612401.735950:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788612401.735952:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff928e98e67000 from 30 10000000:01000000:1.0:1788612401.735955:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788612401.735979:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.735987:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.736007:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612401.736022:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914327936:0@lo:101: 00000100:00100000:1.0:1788612401.736054:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.736078:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e922ae000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.736092:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914327936 00000100:00100000:1.0:1788612401.736096:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914327936 00000100:00100000:1.0:1788612401.736121:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788612401.736128:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914327936:12345-0@lo:101: 00010000:00010000:1.0:1788612401.736137:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612401.736149:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b60600/0xfc956d548af41689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41682 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.736170:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b60600/0xfc956d548af41689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41682 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.736181:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b60600/0xfc956d548af41689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41682 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.736190:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60600, rc 0) 00000100:00100000:1.0:1788612401.736232:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914327936:12345-0@lo:101: Request processed in 103us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.736237:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788612401.736270:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914327936:0@lo:101: 00010000:00010000:1.0:1788612401.736283:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41689 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.736303:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41689 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612401.736348:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914328064:0@lo:501: 00000100:00100000:1.0:1788612401.736374:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.736388:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e922ae000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.736400:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914328064 00000100:00100000:1.0:1788612401.736404:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914328064 00000100:00100000:1.0:1788612401.736421:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788612401.736427:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914328064:12345-0@lo:501: 00000100:00100000:1.0:1788612401.736655:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914328064:12345-0@lo:501: Request processed in 228us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.736663:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788612401.736690:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914328064:0@lo:501: 00000100:00100000:1.0:1788612401.736712:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914328192:0@lo:503: 00000100:00100000:1.0:1788612401.736744:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.736758:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e922ae000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.736769:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914328192 00000100:00100000:1.0:1788612401.736773:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914328192 00000100:00100000:1.0:1788612401.736789:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788612401.736795:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914328192:12345-0@lo:503: 00000100:00100000:1.0:1788612401.736944:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914328192:12345-0@lo:503: Request processed in 149us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.736951:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788612401.736985:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914328192:0@lo:503: 00000100:00100000:0.0:1788612401.747422:0:8109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8109:1875495914328320:0@lo:502: 00000100:00100000:0.0:1788612401.747519:0:8109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.747570:0:8109:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.747794:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914328320 00000100:00100000:1.0:1788612401.747802:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914328320 00000100:00100000:1.0:1788612401.747877:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788612401.747886:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:8109:x1875495914328320:12345-0@lo:502: 00000100:00100000:1.0:1788612401.748125:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:8109:x1875495914328320:12345-0@lo:502: Request processed in 239us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.748132:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788612401.748190:0:8109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8109:1875495914328320:0@lo:502: 00000100:00100000:1.0:1788612401.748251:0:8109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8109:1875495914328448:0@lo:502: 00000100:00100000:1.0:1788612401.748286:0:8109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.748308:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914328448 00000100:00100000:1.0:1788612401.748312:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914328448 00000100:00100000:1.0:1788612401.748333:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788612401.748339:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+16:8109:x1875495914328448:12345-0@lo:502: 00000100:00100000:1.0:1788612401.748457:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+16:8109:x1875495914328448:12345-0@lo:502: Request processed in 118us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.748464:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788612401.748492:0:8109:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e922aeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.748505:0:8109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8109:1875495914328448:0@lo:502: 00000040:00080000:1.0:1788612401.748763:0:8109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788612401.748834:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788612401.748876:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788612401.748885:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41689 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.748896:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41689 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612401.748914:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788612401.748916:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff928e98e67000 from 5 10000000:01000000:1.0:1788612401.748919:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788612401.748944:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.748953:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.748961:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612401.748972:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914328576:0@lo:101: 00000100:00100000:1.0:1788612401.749001:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.749016:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72240 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.749027:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914328576 00000100:00100000:1.0:1788612401.749030:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914328576 00000100:00100000:1.0:1788612401.749048:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788612401.749053:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914328576:12345-0@lo:101: 00010000:00010000:1.0:1788612401.749061:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612401.749072:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b61000/0xfc956d548af41697 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41690 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.749090:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b61000/0xfc956d548af41697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41690 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.749099:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b61000/0xfc956d548af41697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41690 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.749116:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61000, rc 0) 00000100:00100000:1.0:1788612401.749143:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914328576:12345-0@lo:101: Request processed in 89us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.749148:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788612401.749179:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914328576:0@lo:101: 00010000:00010000:1.0:1788612401.749191:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.749199:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612401.749251:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914328704:0@lo:256: 00000100:00100000:1.0:1788612401.749280:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.749292:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72240 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.749304:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914328704 00000100:00100000:1.0:1788612401.749307:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914328704 00000100:00100000:1.0:1788612401.749326:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788612401.749332:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914328704:12345-0@lo:256: 20000000:01000000:1.0:1788612401.749344:0:5847:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788612401.749359:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788612401.749363:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788612401.749432:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914328704:12345-0@lo:256: Request processed in 100us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.749439:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788612401.749472:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914328704:0@lo:256: 10000000:01000000:1.0:1788612401.749517:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788612401.749527:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.749534:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612401.749541:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788612401.749543:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788612401.749546:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788612401.751854:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.751873:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.751884:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612401.751906:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914328832:0@lo:101: 00000100:00100000:1.0:1788612401.751973:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.752009:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72240 going to sleep for 11 seconds 00000100:00100000:0.0:1788612401.752173:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914328832 00000100:00100000:0.0:1788612401.752180:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914328832 00000100:00100000:0.0:1788612401.752244:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788612401.752255:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914328832:12345-0@lo:101: 00010000:00010000:0.0:1788612401.752267:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612401.752280:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e910d7c00/0xfc956d548af416a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af4169e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.752305:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e910d7c00/0xfc956d548af416a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af4169e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.752315:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e910d7c00/0xfc956d548af416a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4169e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612401.752325:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d7c00, rc 0) 00000100:00100000:0.0:1788612401.752379:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914328832:12345-0@lo:101: Request processed in 127us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612401.752386:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788612401.753073:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914328832:0@lo:101: 00010000:00010000:1.0:1788612401.753093:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af416a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.753104:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af416a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612401.753162:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914328960:0@lo:501: 00000100:00100000:1.0:1788612401.753221:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.753277:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72240 going to sleep for 11 seconds 00000100:00100000:0.0:1788612401.761732:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914328960 00000100:00100000:0.0:1788612401.761751:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914328960 00000100:00100000:1.0:1788612401.762045:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788612401.762056:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914328960:12345-0@lo:501: 00000100:00100000:1.0:1788612401.762380:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914328960:12345-0@lo:501: Request processed in 325us (9169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.762388:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788612401.762442:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914328960:0@lo:501: 00000100:00100000:1.0:1788612401.762492:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914329088:0@lo:503: 00000100:00100000:1.0:1788612401.762538:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.762578:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72240 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.762596:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914329088 00000100:00100000:1.0:1788612401.762599:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914329088 00000100:00100000:1.0:1788612401.762636:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788612401.762644:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914329088:12345-0@lo:503: 00000100:00100000:1.0:1788612401.762941:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914329088:12345-0@lo:503: Request processed in 296us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.762949:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788612401.763002:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914329088:0@lo:503: 00000100:00100000:1.0:1788612401.763175:0:8110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8110:1875495914329216:0@lo:502: 00000100:00100000:1.0:1788612401.763205:0:8110:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.763236:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914329216 00000100:00100000:1.0:1788612401.763240:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914329216 00000100:00100000:1.0:1788612401.763261:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788612401.763266:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:8110:x1875495914329216:12345-0@lo:502: 00000100:00100000:1.0:1788612401.763465:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:8110:x1875495914329216:12345-0@lo:502: Request processed in 197us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.763471:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788612401.763503:0:8110:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.763515:0:8110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8110:1875495914329216:0@lo:502: 00000020:01000000:1.0:1788612401.763537:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788612401.763544:0:8110:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788612401.763551:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612401.763554:0:8110:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788612401.763560:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788612401.763564:0:8110:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:1.0:1788612401.763587:0:8110:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788612401.763590:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788612401.763605:0:8110:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff928e911419c0) 00000020:00000080:1.0:1788612401.763626:0:8110:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788612401.763631:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788612401.763698:0:8110:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788612401.763704:0:8110:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788612401.763710:0:8110:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfc956d548af416b3 00010000:00080000:1.0:1788612401.763736:0:8110:0:(ldlm_lib.c:102:import_set_conn()) imp ffff928ebfb4e000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1788612401.763990:0:8110:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788612401.764282:0:8110:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788612401.764295:0:8110:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788612401.764798:0:8110:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612401.765032:0:8110:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612401.765079:0:8110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788612401.765136:0:8110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788612401.773481:0:8111:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788612401.773489:0:8111:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00010000:00010000:0.0:1788612401.781981:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788612401.783207:0:8110:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788612401.783254:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788612401.783295:0:8110:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788612401.783320:0:8110:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfc956d548af416ba 00000100:00080000:0.0:1788612401.783331:0:8110:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788612401.783337:0:8110:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff928ebfb4e000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1788612401.783374:0:8110:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928ec0994e00 x1875495914329344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612401.783405:0:8110:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788612401.783463:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612401.783467:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612401.783469:0:8110:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788612401.783473:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612401.783477:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612401.783478:0:8110:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788612401.783481:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788612401.783482:0:8110:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788612401.783518:0:8110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8110:1875495914329472:0@lo:502: 00000100:00100000:0.0:1788612401.783610:0:8110:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612401.783795:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612401.783807:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914329600:0@lo:400: 00000100:00100000:0.0:1788612401.784024:0:8110:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.784382:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914329344:0@lo:8: 00000100:00100000:0.0:1788612401.785331:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914329728:0@lo:400: 00000100:00100000:3.0:1788612401.789152:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612401.789251:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914329856:0@lo:400: 00000100:00100000:3.0:1788612401.789299:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.789434:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914329600 00000100:00100000:2.0:1788612401.789443:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914329600 00000100:00100000:2.0:1788612401.789489:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914329856 00000100:00100000:2.0:1788612401.789492:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914329856 00000100:00100000:2.0:1788612401.789518:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788612401.789526:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914329600:12345-0@lo:400: 00000100:00100000:2.0:1788612401.789596:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914329600:12345-0@lo:400: Request processed in 71us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612401.789603:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788612401.789620:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788612401.789637:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914329856:12345-0@lo:400: 00000100:00100000:2.0:1788612401.789666:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914329856:12345-0@lo:400: Request processed in 41us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612401.789672:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788612401.789690:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788612401.789725:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec0302300 x1875495914329856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612401.789738:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914329856:0@lo:400: 00010000:00080000:2.0:1788612401.789768:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef5880 x1875495914329600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612401.789778:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914329600:0@lo:400: 00000100:00100000:2.0:1788612401.790197:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914329472 00000100:00100000:2.0:1788612401.790203:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914329472 00000100:00100000:2.0:1788612401.790246:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788612401.790253:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:8110:x1875495914329472:12345-0@lo:502: 00000100:00100000:2.0:1788612401.790494:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:8110:x1875495914329472:12345-0@lo:502: Request processed in 241us (6884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612401.790501:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788612401.790574:0:8110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8110:1875495914329472:0@lo:502: 00000020:01000000:2.0:1788612401.790607:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612401.790614:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612401.790616:0:8110:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788612401.790620:0:8110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788612401.794790:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788612401.794875:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788612401.794888:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af416a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.794901:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af416a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612401.794912:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788612401.794915:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff928e90d3b380 from 1 10000000:01000000:1.0:1788612401.794919:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788612401.794957:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.794965:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.794976:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612401.795000:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914329984:0@lo:101: 00000100:00100000:1.0:1788612401.795060:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.795107:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72300 going to sleep for 11 seconds 00000100:00100000:1.0:1788612401.795133:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.795163:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914329344 00000100:00100000:1.0:1788612401.795171:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914329344 00000100:00100000:1.0:1788612401.795221:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612401.795230:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1875495914329344:12345-0@lo:8: 00010000:00080000:1.0:1788612401.795255:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1788612401.795291:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfc956d548af416c8 00002000:00100000:1.0:1788612401.795304:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff928ebfb49000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788612401.795315:0:6698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788612401.795320:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788612401.795451:0:6698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788612401.795689:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914329984 00000100:00100000:2.0:1788612401.795695:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914329984 00000100:00100000:2.0:1788612401.795731:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788612401.795739:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914329984:12345-0@lo:101: 00010000:00010000:2.0:1788612401.795752:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612401.795765:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e8200/0xfc956d548af416cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af416c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612401.795792:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e8200/0xfc956d548af416cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af416c1 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612401.795804:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e8200/0xfc956d548af416cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af416c1 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612401.795814:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8200, rc 0) 00000100:00100000:2.0:1788612401.795895:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914329984:12345-0@lo:101: Request processed in 156us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612401.795911:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00002000:00080000:1.0:1788612401.796257:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788612401.796288:0:6698:0:(import.c:65:import_set_state_nolock()) ffff928ebfb4b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612401.796329:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875495914329344:12345-0@lo:8: Request processed in 1099us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.796336:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612401.796374:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914329984:0@lo:101: 00010000:00010000:1.0:1788612401.796391:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af416cf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.796401:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af416cf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612401.796459:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914330112:0@lo:501: 00000100:00100000:1.0:1788612401.796490:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612401.796867:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72300 going to sleep for 11 seconds 00010000:00080000:1.0:1788612401.796893:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec0994e00 x1875495914329344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612401.796903:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788612401.796910:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788612401.796917:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788612401.796922:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788612401.796924:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928ebfb4e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788612401.796944:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788612401.796949:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914329344:0@lo:8: 00000004:00080000:1.0:1788612401.796981:0:8111:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788612401.797106:0:8111:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 195640267698ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788612401.797772:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.797857:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914329728 00000100:00100000:0.0:1788612401.797864:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914329728 00000100:00100000:0.0:1788612401.797918:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612401.797927:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914329728:12345-0@lo:400: 00000100:00100000:0.0:1788612401.797979:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914329728:12345-0@lo:400: Request processed in 54us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612401.797985:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788612401.798003:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788612401.798027:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec0300700 x1875495914329728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612401.798039:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914329728:0@lo:400: 00000100:00100000:2.0:1788612401.805357:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914330112 00000100:00100000:2.0:1788612401.805371:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914330112 00000100:00100000:2.0:1788612401.810799:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788612401.810926:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914330112:12345-0@lo:501: 00000100:00100000:2.0:1788612401.811177:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914330112:12345-0@lo:501: Request processed in 363us (14684us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788612401.811185:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788612401.811288:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914330112:0@lo:501: 10000000:01000000:1.0:1788612401.811345:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788612401.811355:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af416cf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612401.811367:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af416cf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788612401.855436:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788612401.927030:0:8112:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788612401.927078:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875495914330368:0@lo:7: 00000100:00100000:0.0:1788612401.927152:0:8112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.927206:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788612401.927250:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914330240:0@lo:13: 00000100:00100000:0.0:1788612401.929801:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.929999:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914330368 00000100:00100000:0.0:1788612401.930008:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914330368 00000100:00100000:0.0:1788612401.930064:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788612401.930074:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8112:x1875495914330368:12345-0@lo:7: 00000100:00080000:1.0:1788612401.932288:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612401.933609:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914330240 00000100:00100000:3.0:1788612401.933622:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914330240 00000100:00100000:3.0:1788612401.933688:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612401.933698:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875495914330240:12345-0@lo:13: 00002000:00000024:3.0:1788612401.933731:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788612401.933829:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875495914330240:12345-0@lo:13: Request processed in 132us (4031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.933853:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788612401.935037:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec0995180 x1875495914330240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612401.935059:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914330240:0@lo:13: 00002000:00080000:1.0:1788612401.942963:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788612401.943038:0:6697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788612401.943200:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8112:x1875495914330368:12345-0@lo:7: Request processed in 13124us (16043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612401.943220:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788612401.943364:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98e92a00 x1875495914330368/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788612417 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612401.943380:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875495914330368:0@lo:7: 00000004:00080000:0.0:1788612401.943393:0:8112:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788612401.943439:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875495914330496:0@lo:5: 00000100:00100000:0.0:1788612401.943473:0:8112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.943638:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612401.943732:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914330496 00000100:00100000:3.0:1788612401.943738:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914330496 00000100:00100000:3.0:1788612401.943913:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612401.943924:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8112:x1875495914330496:12345-0@lo:5: 00002000:00080000:3.0:1788612401.943951:0:6695:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788612401.943954:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788612401.945367:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8112:x1875495914330496:12345-0@lo:5: Request processed in 1440us (1889us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788612401.945377:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788612401.945386:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98e92a00 x1875495914330496/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612417 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612401.945403:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875495914330496:0@lo:5: 00000004:00080000:2.0:1788612401.945416:0:8112:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788612401.945449:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0302300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875495914330624:0@lo:700: 00000100:00100000:2.0:1788612401.945486:0:8112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612401.945514:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea342ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612401.945588:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914330624 00000100:00100000:0.0:1788612401.945595:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914330624 00000100:00100000:0.0:1788612401.945717:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612401.945728:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8112:x1875495914330624:12345-0@lo:700: 00000100:00100000:0.0:1788612401.945762:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6704:1875495914330752:0@lo:700: 00000100:00100000:0.0:1788612401.945793:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612401.945904:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788612401.946008:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914330752 00000100:00100000:2.0:1788612401.946012:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914330752 00000100:00100000:2.0:1788612401.946046:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788612401.946052:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6704:x1875495914330752:12345-0@lo:700: 40000000:02000000:2.0:1788612401.989441:0:5859:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788612401.997672:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6704:x1875495914330752:12345-0@lo:700: Request processed in 51611us (51870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612401.997696:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788612401.997730:0:6704:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98e90380 x1875495914330752/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788612417 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612401.997745:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6704:1875495914330752:0@lo:700: 40000000:02000000:0.0:1788612401.997758:0:6704:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1788612402.181092:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8112:x1875495914330624:12345-0@lo:700: Request processed in 235360us (235598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612402.181111:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:2.0:1788612402.182796:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788612402.182817:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:0.0:1788612402.183686:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec0302300 x1875495914330624/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788612417 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612402.183704:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0302300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875495914330624:0@lo:700: 00000004:02000040:2.0:1788612402.255933:0:8112:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788612402.264262:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875495914330880:0@lo:5: 00000100:00100000:0.0:1788612402.264328:0:8112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612402.264380:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788612402.264437:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914330880 00000100:00100000:1.0:1788612402.264445:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914330880 00000100:00100000:1.0:1788612402.264507:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788612402.264517:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8112:x1875495914330880:12345-0@lo:5: 00002000:00080000:1.0:1788612402.282427:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788612402.282453:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788612402.297070:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8112:x1875495914330880:12345-0@lo:5: Request processed in 32548us (32735us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788612402.297100:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788612402.297153:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98e90380 x1875495914330880/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612418 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612402.297166:0:8112:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788612402.297178:0:8112:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff928e98e90380 x1875495914330880/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612418 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612402.297190:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875495914330880:0@lo:5: 00000004:00080000:1.0:1788612402.297215:0:8112:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788612402.801079:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788612403.602986:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788612403.820619:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612404.315315:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612404.315470:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893336192 00000100:00100000:3.0:1788612404.315480:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893336192 00000100:00100000:3.0:1788612404.315526:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 112 00000100:00100000:3.0:1788612404.315543:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1875495893336192:12345-192.168.202.6@tcp:250: 00010000:00080000:3.0:1788612404.315572:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 93581484-5c48-42e2-a9bb-7e5e07222f81@192.168.202.6@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:3.0:1788612404.315601:0:5846:0:(genops.c:1385:class_connect()) connect: client 93581484-5c48-42e2-a9bb-7e5e07222f81, cookie 0xfc956d548af416d6 00000100:00080000:3.0:1788612404.315740:0:5846:0:(import.c:65:import_set_state_nolock()) ffff928eacf48000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612404.315823:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+5:2352:x1875495893336192:12345-192.168.202.6@tcp:250: Request processed in 280us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612404.315831:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 112 00000100:00100000:1.0:1788612404.331436:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612404.331473:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893336320 00000100:00100000:1.0:1788612404.331483:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893336320 00000100:00100000:1.0:1788612404.331538:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 113 00000100:00100000:1.0:1788612404.331548:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+5:5582:x1875495893336320:12345-192.168.202.6@tcp:101: 00010000:00010000:1.0:1788612404.331565:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612404.331586:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b61a00/0xfc956d548af416dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd76f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612404.331619:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b61a00/0xfc956d548af416dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd76f expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612404.331631:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b61a00/0xfc956d548af416dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd76f expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612404.331641:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61a00, rc 0) 00000100:00100000:1.0:1788612404.331695:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+6:5582:x1875495893336320:12345-192.168.202.6@tcp:101: Request processed in 147us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612404.331715:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 113 00000100:00100000:0.0:1788612404.335897:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612404.336024:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893336448 00000100:00100000:1.0:1788612404.336046:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893336448 00000100:00100000:1.0:1788612404.336104:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00100000:1.0:1788612404.336114:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+6:5582:x1875495893336448:12345-192.168.202.6@tcp:501: 00000100:00100000:1.0:1788612404.336663:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+6:5582:x1875495893336448:12345-192.168.202.6@tcp:501: Request processed in 547us (771us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788612404.336671:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00100000:0.0:1788612404.343308:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612404.343597:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893336576 00000100:00100000:3.0:1788612404.343608:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893336576 00000100:00100000:3.0:1788612404.343668:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:3.0:1788612404.343679:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+6:5582:x1875495893336576:12345-192.168.202.6@tcp:101: 00010000:00010000:3.0:1788612404.343695:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612404.343714:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e80031800/0xfc956d548af416e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd776 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612404.343742:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e80031800/0xfc956d548af416e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd776 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612404.343754:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e80031800/0xfc956d548af416e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd776 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612404.344493:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80031800, rc 0) 00000100:00100000:3.0:1788612404.345014:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+7:5582:x1875495893336576:12345-192.168.202.6@tcp:101: Request processed in 1333us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612404.345023:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:2.0:1788612404.356545:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612404.356675:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893336704 00000100:00100000:0.0:1788612404.356686:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893336704 00000100:00100000:0.0:1788612404.356739:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:0.0:1788612404.356756:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+7:5582:x1875495893336704:12345-192.168.202.6@tcp:501: 00000100:00100000:0.0:1788612404.357073:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+8:5582:x1875495893336704:12345-192.168.202.6@tcp:501: Request processed in 317us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612404.357081:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:2.0:1788612404.362681:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612404.362731:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893336832 00000100:00100000:2.0:1788612404.362740:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893336832 00000100:00100000:2.0:1788612404.362805:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:2.0:1788612404.362816:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+8:5582:x1875495893336832:12345-192.168.202.6@tcp:503: 00000100:00100000:2.0:1788612404.363180:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+8:5582:x1875495893336832:12345-192.168.202.6@tcp:503: Request processed in 365us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612404.363199:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:0.0:1788612404.367987:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612404.368144:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893336960 00000100:00100000:1.0:1788612404.368154:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893336960 00000100:00100000:1.0:1788612404.368218:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:1.0:1788612404.368227:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+8:5601:x1875495893336960:12345-192.168.202.6@tcp:502: 00000100:00100000:1.0:1788612404.368802:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+8:5601:x1875495893336960:12345-192.168.202.6@tcp:502: Request processed in 574us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612404.368811:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:2.0:1788612404.407570:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612404.407706:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893337088 00000100:00100000:3.0:1788612404.407717:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893337088 00000100:00100000:3.0:1788612404.407779:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:3.0:1788612404.407790:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+8:5601:x1875495893337088:12345-192.168.202.6@tcp:502: 00000100:00100000:3.0:1788612404.408082:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+8:5601:x1875495893337088:12345-192.168.202.6@tcp:502: Request processed in 293us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612404.408090:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:2.0:1788612404.420949:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612404.423637:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893337216 00000100:00100000:0.0:1788612404.423653:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893337216 00000100:00100000:0.0:1788612404.423717:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:0.0:1788612404.423726:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+8:5582:x1875495893337216:12345-192.168.202.6@tcp:101: 00010000:00010000:0.0:1788612404.423744:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612404.423760:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e910d6600/0xfc956d548af416eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd7a0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612404.425696:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e910d6600/0xfc956d548af416eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7a0 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612404.425714:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e910d6600/0xfc956d548af416eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7a0 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612404.425724:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d6600, rc 0) 00000100:00100000:0.0:1788612404.427255:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+9:5582:x1875495893337216:12345-192.168.202.6@tcp:101: Request processed in 3520us (6476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612404.427267:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:0.0:1788612404.430033:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612404.430129:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893337344 00000100:00100000:2.0:1788612404.430140:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893337344 00000100:00100000:2.0:1788612404.430206:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:2.0:1788612404.430217:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+9:5582:x1875495893337344:12345-192.168.202.6@tcp:256: 20000000:01000000:2.0:1788612404.430250:0:5846:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788612404.430273:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788612404.430277:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788612404.430280:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788612404.430283:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788612404.433066:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+9:5582:x1875495893337344:12345-192.168.202.6@tcp:256: Request processed in 2841us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612404.433081:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:3.0:1788612404.438656:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612404.439605:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893337472 00000100:00100000:1.0:1788612404.439618:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893337472 00000100:00100000:1.0:1788612404.439674:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:1.0:1788612404.439684:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+9:5582:x1875495893337472:12345-192.168.202.6@tcp:101: 00010000:00010000:1.0:1788612404.439702:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612404.439721:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b60800/0xfc956d548af416f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd7a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612404.439750:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b60800/0xfc956d548af416f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7a7 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612404.439999:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b60800/0xfc956d548af416f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7a7 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612404.440009:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60800, rc 0) 00000100:00100000:1.0:1788612404.440070:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5582:x1875495893337472:12345-192.168.202.6@tcp:101: Request processed in 387us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612404.440077:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:2.0:1788612404.445645:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612404.445736:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893337600 00000100:00100000:3.0:1788612404.445746:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893337600 00000100:00100000:3.0:1788612404.445881:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:3.0:1788612404.445894:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5582:x1875495893337600:12345-192.168.202.6@tcp:501: 00000100:00100000:3.0:1788612404.446177:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5582:x1875495893337600:12345-192.168.202.6@tcp:501: Request processed in 284us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612404.446194:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:2.0:1788612404.449964:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612404.450086:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893337728 00000100:00100000:3.0:1788612404.450097:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893337728 00000100:00100000:3.0:1788612404.450152:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:3.0:1788612404.450174:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5582:x1875495893337728:12345-192.168.202.6@tcp:503: 00000100:00100000:3.0:1788612404.450540:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5582:x1875495893337728:12345-192.168.202.6@tcp:503: Request processed in 366us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612404.450549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:0.0:1788612404.453648:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612404.453713:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893337856 00000100:00100000:3.0:1788612404.453723:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893337856 00000100:00100000:3.0:1788612404.454538:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:3.0:1788612404.454552:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5605:x1875495893337856:12345-192.168.202.6@tcp:502: 00000100:00100000:3.0:1788612404.454820:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5605:x1875495893337856:12345-192.168.202.6@tcp:502: Request processed in 271us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612404.454829:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:2.0:1788612404.460496:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612404.460574:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893337984 00000100:00100000:3.0:1788612404.460584:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893337984 00000100:00100000:3.0:1788612404.460637:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:3.0:1788612404.460647:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5605:x1875495893337984:12345-192.168.202.6@tcp:502: 00000100:00100000:3.0:1788612404.460985:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5605:x1875495893337984:12345-192.168.202.6@tcp:502: Request processed in 338us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612404.460994:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:0.0:1788612404.465086:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612404.465194:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893338112 00000100:00100000:1.0:1788612404.465204:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893338112 00000100:00100000:1.0:1788612404.465258:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:1.0:1788612404.465266:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1875495893338112:12345-192.168.202.6@tcp:38: 00010000:00080000:1.0:1788612404.465295:0:5854:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1788612404.465615:0:5854:0:(genops.c:1385:class_connect()) connect: client f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab, cookie 0xfc956d548af416f9 00000004:00100000:1.0:1788612404.465645:0:5854:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788612404.465651:0:5854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788612404.514873:0:5854:0:(import.c:65:import_set_state_nolock()) ffff928d85298000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612404.514936:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2352:x1875495893338112:12345-192.168.202.6@tcp:38: Request processed in 49669us (49861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612404.514945:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00010000:00010000:1.0:1788612404.844123:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612405.527275:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612405.527362:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893338240 00000100:00100000:0.0:1788612405.527383:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893338240 00000100:00100000:0.0:1788612405.527454:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:0.0:1788612405.527465:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:0:x1875495893338240:12345-192.168.202.6@tcp:41: 00000004:00000024:0.0:1788612405.527509:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788612405.527594:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:0:x1875495893338240:12345-192.168.202.6@tcp:41: Request processed in 131us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612405.527602:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00080000:1.0:1788612405.527669:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612405.532877:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612405.532975:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893338368 00000100:00100000:1.0:1788612405.532995:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893338368 00000100:00100000:1.0:1788612405.533055:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:1.0:1788612405.533065:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:5582:x1875495893338368:12345-192.168.202.6@tcp:41: 00000004:00000024:1.0:1788612405.533106:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788612405.533210:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:5582:x1875495893338368:12345-192.168.202.6@tcp:41: Request processed in 146us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612405.533217:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:3.0:1788612405.539813:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612405.539977:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893338496 00000100:00100000:2.0:1788612405.539997:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893338496 00000100:00100000:2.0:1788612405.540060:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:2.0:1788612405.540082:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:5582:x1875495893338496:12345-192.168.202.6@tcp:40: 00000100:00100000:2.0:1788612405.540169:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:5582:x1875495893338496:12345-192.168.202.6@tcp:40: Request processed in 99us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612405.540198:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:2.0:1788612405.545637:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612405.545688:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612405.545873:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893339008 00000100:00100000:0.0:1788612405.545883:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893339008 00000100:00100000:0.0:1788612405.545945:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:0.0:1788612405.545956:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2354:x1875495893339008:12345-192.168.202.6@tcp:400: 00000100:00100000:0.0:1788612405.546040:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2354:x1875495893339008:12345-192.168.202.6@tcp:400: Request processed in 86us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612405.546049:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:3.0:1788612405.546554:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893338880 00000100:00100000:3.0:1788612405.546560:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893338880 00000100:00100000:3.0:1788612405.546601:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1788612405.546610:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:5582:x1875495893338880:12345-192.168.202.6@tcp:33: 00000100:00100000:1.0:1788612405.547898:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612405.547929:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612405.547948:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893338624 00000100:00100000:1.0:1788612405.547954:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893338624 00000100:00100000:1.0:1788612405.547975:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893338752 00000100:00100000:1.0:1788612405.547977:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893338752 00000100:00100000:1.0:1788612405.547987:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:1.0:1788612405.547993:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875495893338624:12345-192.168.202.6@tcp:8: 00010000:00080000:1.0:1788612405.548029:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1788612405.548054:0:6695:0:(genops.c:1385:class_connect()) connect: client f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab, cookie 0xfc956d548af41700 00002000:00100000:1.0:1788612405.548065:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab/ffff928e90c64000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788612405.548086:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788612405.548421:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788612405.548448:0:6695:0:(import.c:65:import_set_state_nolock()) ffff928e90c67000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612405.548499:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2352:x1875495893338624:12345-192.168.202.6@tcp:8: Request processed in 503us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612405.548506:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:1.0:1788612405.548523:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:1.0:1788612405.548527:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875495893338752:12345-192.168.202.6@tcp:8: 00010000:00080000:1.0:1788612405.548544:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1788612405.548561:0:6695:0:(genops.c:1385:class_connect()) connect: client f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab, cookie 0xfc956d548af41707 00002000:00100000:1.0:1788612405.548566:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab/ffff928e90c62800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788612405.548590:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788612405.548811:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788612405.548828:0:6695:0:(import.c:65:import_set_state_nolock()) ffff928e90c63000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612405.548895:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2352:x1875495893338752:12345-192.168.202.6@tcp:8: Request processed in 365us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612405.548902:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000004:00080000:3.0:1788612405.585414:0:5855:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 38742us 00000004:00200000:2.0:1788612405.624169:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788612405.624688:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:5582:x1875495893338880:12345-192.168.202.6@tcp:33: Request processed in 78071us (79054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612405.624705:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:1.0:1788612405.821004:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612405.821107:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893339136 00000100:00100000:0.0:1788612405.821117:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893339136 00000100:00100000:0.0:1788612405.821200:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:0.0:1788612405.821212:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:5622:x1875495893339136:12345-192.168.202.6@tcp:101: 00010000:00010000:0.0:1788612405.821232:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612405.821291:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af4170e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd7d1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612405.822504:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41715 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612405.822521:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612405.822564:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612405.822601:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788612405.822606:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612405.822621:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612405.822649:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af4170e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7d1 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612405.822668:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41715 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7d1 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612405.822678:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e91fbb900) 00010000:00010000:0.0:1788612405.822681:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612405.822684:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d7600, rc 0) 00000100:00100000:0.0:1788612405.822751:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:5622:x1875495893339136:12345-192.168.202.6@tcp:101: Request processed in 1542us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612405.822759:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00010000:00010000:3.0:1788612405.869445:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612406.316322:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914331008:0@lo:13: 00000100:00100000:2.0:1788612406.316413:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612406.316481:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914331008 00000100:00100000:0.0:1788612406.316491:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914331008 00000100:00100000:0.0:1788612406.316675:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788612406.316685:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0301880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914331008:12345-0@lo:13: 00000100:00080000:1.0:1788612406.316746:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788612406.317369:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612406.323467:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0301880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914331008:12345-0@lo:13: Request processed in 6773us (7044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612406.323577:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788612406.324285:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef4e00 x1875495914331008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612406.324309:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914331008:0@lo:13: 00000100:00100000:0.0:1788612406.828817:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914331136:0@lo:400: 00000100:00100000:0.0:1788612406.828914:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612406.829022:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914331136 00000100:00100000:3.0:1788612406.829031:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914331136 00000100:00100000:3.0:1788612406.829090:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788612406.829100:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3307:x1875495914331136:12345-0@lo:400: 00000100:00100000:2.0:1788612406.829776:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914331264:0@lo:400: 00000100:00100000:2.0:1788612406.829814:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612406.829876:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914331264 00000100:00100000:2.0:1788612406.829881:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914331264 00000100:00100000:2.0:1788612406.829918:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612406.829925:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914331264:12345-0@lo:400: 00000100:00100000:2.0:1788612406.829965:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914331264:12345-0@lo:400: Request processed in 40us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612406.829972:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612406.830025:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914331264:0@lo:400: 00000100:00100000:3.0:1788612406.834794:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3307:x1875495914331136:12345-0@lo:400: Request processed in 5590us (5774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612406.834810:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788612406.835284:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914331136:0@lo:400: 00000100:00100000:2.0:1788612406.836006:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612406.841306:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914331520:0@lo:400: 00000100:00100000:2.0:1788612406.841382:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612406.841443:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914331392:0@lo:400: 00000100:00100000:2.0:1788612406.841466:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612406.841677:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914331520 00000100:00100000:3.0:1788612406.841698:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914331520 00000100:00100000:3.0:1788612406.841759:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914331392 00000100:00100000:3.0:1788612406.841763:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914331392 00000100:00100000:3.0:1788612406.841783:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788612406.841793:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914331520:12345-0@lo:400: 00000100:00100000:3.0:1788612406.841869:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914331520:12345-0@lo:400: Request processed in 78us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612406.841876:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788612406.841895:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788612406.841902:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875495914331392:12345-0@lo:400: 00000100:00100000:3.0:1788612406.841930:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875495914331392:12345-0@lo:400: Request processed in 29us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612406.841936:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788612406.841971:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612406.842470:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914331520:0@lo:400: 00000100:00100000:2.0:1788612406.842485:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914331392:0@lo:400: 00000100:00100000:2.0:1788612406.846518:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612406.846548:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914331648:0@lo:400: 00000100:00100000:2.0:1788612406.846628:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612406.847492:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914331648 00000100:00100000:1.0:1788612406.847501:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914331648 00000100:00100000:1.0:1788612406.847578:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612406.847588:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914331648:12345-0@lo:400: 00000100:00100000:1.0:1788612406.847675:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914331648:12345-0@lo:400: Request processed in 89us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612406.847682:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788612406.847814:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788612406.847901:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ebf81c700 x1875495914331648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612406.847914:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788612406.847928:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914331648:0@lo:400: 00010000:00010000:1.0:1788612406.892072:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612407.340490:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914331776:0@lo:13: 00000100:00100000:2.0:1788612407.340580:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612407.340780:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914331776 00000100:00100000:0.0:1788612407.340790:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914331776 00000100:00100000:0.0:1788612407.340866:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788612407.340877:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec074b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914331776:12345-0@lo:13: 00002000:00000024:0.0:1788612407.340917:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612407.340976:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec074b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914331776:12345-0@lo:13: Request processed in 101us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612407.340984:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788612407.341345:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ebf81c380 x1875495914331776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612407.341364:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914331776:0@lo:13: 00000100:00100000:1.0:1788612407.892677:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612407.892774:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893339264 00000100:00100000:3.0:1788612407.892784:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893339264 00000100:00100000:3.0:1788612407.892911:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:3.0:1788612407.892924:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:5674:x1875495893339264:12345-192.168.202.6@tcp:41: 00000004:00000024:3.0:1788612407.892993:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788612407.893070:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:5674:x1875495893339264:12345-192.168.202.6@tcp:41: Request processed in 149us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612407.893078:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00080000:1.0:1788612407.894045:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612407.896526:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612407.896630:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893339392 00000100:00100000:0.0:1788612407.896642:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893339392 00000100:00100000:0.0:1788612407.896723:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:0.0:1788612407.896735:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:5674:x1875495893339392:12345-192.168.202.6@tcp:13: 00002000:00000024:0.0:1788612407.896783:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612407.896885:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:5674:x1875495893339392:12345-192.168.202.6@tcp:13: Request processed in 153us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612407.896901:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00080000:1.0:1788612407.897170:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612407.915611:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612407.915744:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893339520 00000100:00100000:0.0:1788612407.915776:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893339520 00000100:00100000:0.0:1788612407.915885:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:0.0:1788612407.915895:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:5674:x1875495893339520:12345-192.168.202.6@tcp:13: 00002000:00000024:0.0:1788612407.915926:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612407.916008:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:5674:x1875495893339520:12345-192.168.202.6@tcp:13: Request processed in 114us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612407.916015:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00080000:1.0:1788612407.916193:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788612407.918342:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788612408.419471:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00010000:00010000:1.0:1788612408.952421:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612409.972977:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788612410.045076:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000001:00100000:1.0:1788612410.059358:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000001:02000400:3.0:1788612410.810420:0:8297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788612410.817821:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612410.817883:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612410.817920:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612410.817952:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612410.817977:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893340032 00000100:00100000:1.0:1788612410.817987:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893340032 00000100:00100000:1.0:1788612410.818052:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893339904 00000100:00100000:1.0:1788612410.818056:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893339904 00000100:00100000:1.0:1788612410.818075:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:1.0:1788612410.818084:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2353:x1875495893340032:12345-192.168.202.6@tcp:400: 00000100:00100000:1.0:1788612410.818171:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2353:x1875495893340032:12345-192.168.202.6@tcp:400: Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612410.818179:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:1.0:1788612410.818195:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:1.0:1788612410.818203:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2353:x1875495893339904:12345-192.168.202.6@tcp:400: 00000100:00100000:1.0:1788612410.818228:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2353:x1875495893339904:12345-192.168.202.6@tcp:400: Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612410.818235:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00080000:1.0:1788612410.818251:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612410.818255:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612410.819571:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893339648 00000100:00100000:2.0:1788612410.819580:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893339648 00000100:00100000:2.0:1788612410.819630:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 129 00000100:00100000:2.0:1788612410.819638:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2353:x1875495893339648:12345-192.168.202.6@tcp:400: 00000100:00100000:2.0:1788612410.819682:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2353:x1875495893339648:12345-192.168.202.6@tcp:400: Request processed in 45us (1762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612410.819689:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 129 00000100:00100000:3.0:1788612410.821121:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893339776 00000100:00100000:3.0:1788612410.821140:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893339776 00000100:00100000:3.0:1788612410.821209:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:3.0:1788612410.821219:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2353:x1875495893339776:12345-192.168.202.6@tcp:400: 00000100:00100000:3.0:1788612410.821288:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2353:x1875495893339776:12345-192.168.202.6@tcp:400: Request processed in 71us (3477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612410.821294:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00080000:2.0:1788612410.825187:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788612410.989870:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612411.438417:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612411.438456:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914331904:0@lo:13: 00000100:00100000:2.0:1788612411.438517:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612411.438689:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914331904 00000100:00100000:3.0:1788612411.438696:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914331904 00000100:00100000:3.0:1788612411.438752:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788612411.438760:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec074ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914331904:12345-0@lo:13: 00002000:00000024:3.0:1788612411.438796:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612411.438866:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec074ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914331904:12345-0@lo:13: Request processed in 76us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612411.438873:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788612411.438913:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef7480 x1875495914331904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612411.438927:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914331904:0@lo:13: 00000100:00080000:2.0:1788612411.439297:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612411.950747:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914332160:0@lo:400: 00000100:00100000:3.0:1788612411.950815:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612411.950907:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612411.950915:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914332288:0@lo:400: 00000100:00100000:3.0:1788612411.950938:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612411.950974:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914332160 00000100:00100000:3.0:1788612411.950982:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914332160 00000100:00100000:3.0:1788612411.951019:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914332288 00000100:00100000:3.0:1788612411.951022:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914332288 00000100:00100000:0.0:1788612411.951184:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914332032:0@lo:400: 00000100:00100000:0.0:1788612411.951219:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612411.951245:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914332544:0@lo:400: 00000100:00100000:0.0:1788612411.951269:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612411.951289:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612411.951295:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914332416:0@lo:400: 00000100:00100000:0.0:1788612411.951314:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612411.951336:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914332032 00000100:00100000:0.0:1788612411.951339:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914332032 00000100:00100000:0.0:1788612411.951367:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788612411.951377:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3306:x1875495914332032:12345-0@lo:400: 00000100:00100000:0.0:1788612411.951423:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3306:x1875495914332032:12345-0@lo:400: Request processed in 48us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612411.951431:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788612411.951459:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914332544 00000100:00100000:0.0:1788612411.951462:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914332544 00000100:00100000:0.0:1788612411.951494:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788612411.951501:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914332544:12345-0@lo:400: 00000100:00100000:0.0:1788612411.951536:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914332544:12345-0@lo:400: Request processed in 36us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612411.951556:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788612411.951577:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612411.951609:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914332032:0@lo:400: 00010000:00080000:0.0:1788612411.951622:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef7b80 x1875495914332544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612411.951634:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914332544:0@lo:400: 00000100:00100000:0.0:1788612411.951671:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914332416 00000100:00100000:0.0:1788612411.951674:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914332416 00000100:00100000:3.0:1788612411.952055:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788612411.952092:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612411.954271:0:5853:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788612411.954282:0:5853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788612411.954395:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788612411.954405:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914332288:12345-0@lo:400: 00000100:00100000:0.0:1788612411.954473:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914332288:12345-0@lo:400: Request processed in 72us (3535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612411.954478:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788612411.954492:0:5853:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788612411.954497:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788612411.954503:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914332416:12345-0@lo:400: 00000100:00100000:0.0:1788612411.954534:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914332416:12345-0@lo:400: Request processed in 31us (3219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612411.954541:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788612411.954578:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914332416:0@lo:400: 00000100:00100000:3.0:1788612411.954794:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914332160:12345-0@lo:400: 00000100:00100000:3.0:1788612411.954824:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914332160:12345-0@lo:400: Request processed in 2764us (4011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612411.954829:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788612411.954988:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914332288:0@lo:400: 00000100:00100000:3.0:1788612411.955002:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914332160:0@lo:400: 00010000:00010000:2.0:1788612412.012139:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612412.464570:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612412.464599:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914332672:0@lo:13: 00000100:00100000:1.0:1788612412.464667:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612412.464730:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914332672 00000100:00100000:1.0:1788612412.464738:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914332672 00000100:00100000:1.0:1788612412.464784:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788612412.464793:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914332672:12345-0@lo:13: 00002000:00000024:1.0:1788612412.464832:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612412.464895:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914332672:12345-0@lo:13: Request processed in 102us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612412.464902:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788612412.465073:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ebf81d180 x1875495914332672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612412.465106:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914332672:0@lo:13: 00010000:00010000:0.0:1788612413.038073:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612414.063178:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788612414.654070:0:8445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe39d84d80 20000000:00000080:0.0:1788612414.654107:0:8445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff928d84a87c00 uarg=0000000000000000 20000000:01000000:0.0:1788612414.654142:0:8445:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788612414.654144:0:8445:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788612414.654147:0:8445:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788612414.654151:0:8445:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788612414.654156:0:8445:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788612414.654170:0:8445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788612414.654172:0:8445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788612414.654354:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788612414.654357:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788612414.656417:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788612414.657305:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788612414.657378:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788612414.657419:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1788612414.657506:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788612414.657509:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788612414.661995:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788612414.665663:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788612414.665771:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788612414.665815:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1788612414.665833:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788612414.665905:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788612414.667174:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788612414.667742:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788612414.667794:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788612414.668119:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788612414.668149:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788612414.668151:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788612414.669582:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788612414.670396:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788612414.670543:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788612414.670579:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1788612414.670594:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788612414.670613:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.670631:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e90b61e00/0xfc956d548af41619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41612 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.670648:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e910d7e00/0xfc956d548af41643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4163c expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.670655:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e80030c00/0xfc956d548af4166d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41666 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.670662:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e80030000/0xfc956d548af4167b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41674 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.670669:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e90b60600/0xfc956d548af41689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41682 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.670675:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e910d7c00/0xfc956d548af416a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4169e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.670682:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ec21e8200/0xfc956d548af416cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af416c1 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.670691:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e90b61a00/0xfc956d548af416dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd76f expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.670699:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e80031800/0xfc956d548af416e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd776 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.670706:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.670747:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e80031800/0xfc956d548af416e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd776 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.670772:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928e80031800/0xfc956d548af416e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd776 expref: 9 pid: 5846 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612414.670787:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e93100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914332800:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612414.671153:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e90b61a00/0xfc956d548af416dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd76f expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.671163:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928e90b61a00/0xfc956d548af416dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd76f expref: 9 pid: 5844 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612414.671172:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914332928:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612414.671211:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ec21e8200/0xfc956d548af416cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af416c1 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.671218:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928ec21e8200/0xfc956d548af416cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af416c1 expref: 18 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612414.671226:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914333056:0@lo:104: 00000100:00100000:0.0:1788612414.671262:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612414.671305:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e910d7c00/0xfc956d548af416a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af4169e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.671313:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e910d7c00/0xfc956d548af416a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af4169e expref: 18 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612414.671321:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e91f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914333184:0@lo:104: 00000100:00100000:0.0:1788612414.671346:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612414.671386:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e90b60600/0xfc956d548af41689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af41682 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.671394:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e90b60600/0xfc956d548af41689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af41682 expref: 18 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612414.671402:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e93b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914333312:0@lo:104: 00010000:00010000:0.0:1788612414.671427:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e80030000/0xfc956d548af4167b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af41674 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.671449:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e80030000/0xfc956d548af4167b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af41674 expref: 18 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612414.671457:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914333440:0@lo:104: 00010000:00010000:0.0:1788612414.671482:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e80030c00/0xfc956d548af4166d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af41666 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.671489:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e80030c00/0xfc956d548af4166d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af41666 expref: 18 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612414.671497:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914333568:0@lo:104: 00010000:00010000:0.0:1788612414.671519:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e910d7e00/0xfc956d548af41643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af4163c expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.671527:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e910d7e00/0xfc956d548af41643 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af4163c expref: 18 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612414.671535:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e91180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914333696:0@lo:104: 00010000:00010000:0.0:1788612414.671557:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e90b61e00/0xfc956d548af41619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af41612 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.671576:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e90b61e00/0xfc956d548af41619 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af41612 expref: 18 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612414.671586:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914333824:0@lo:104: 00000100:00100000:0.0:1788612414.671607:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eadfc6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788612414.671819:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788612414.671874:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612414.671894:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612414.671900:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612414.671908:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612414.671915:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612414.671922:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914333056 00000100:00100000:2.0:1788612414.671929:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914333056 00000100:00100000:2.0:1788612414.671977:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914333184 00000100:00100000:2.0:1788612414.671980:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914333184 00000100:00100000:2.0:1788612414.671990:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914333312 00000100:00100000:2.0:1788612414.671992:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914333312 00000100:00100000:2.0:1788612414.672001:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914333440 00000100:00100000:2.0:1788612414.672002:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914333440 00000100:00100000:2.0:1788612414.672010:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914333568 00000100:00100000:2.0:1788612414.672012:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914333568 00000100:00100000:2.0:1788612414.672019:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914333696 00000100:00100000:2.0:1788612414.672022:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914333696 00000100:00100000:2.0:1788612414.672030:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914333824 00000100:00100000:2.0:1788612414.672032:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914333824 00000100:00100000:2.0:1788612414.672043:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612414.672051:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+9:8445:x1875495914333056:12345-0@lo:104: 00010000:00010000:2.0:1788612414.672064:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af416cf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.672143:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612414.672149:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+9:8445:x1875495914333056:12345-0@lo:104: Request processed in 99us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612414.672156:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612414.672186:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612414.672193:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d852b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+8:8445:x1875495914333184:12345-0@lo:104: 00010000:00010000:2.0:1788612414.672201:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af416a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.672234:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788612414.672239:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d852b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+8:8445:x1875495914333184:12345-0@lo:104: Request processed in 48us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612414.672245:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612414.672279:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788612414.672286:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+7:8445:x1875495914333312:12345-0@lo:104: 00010000:00010000:2.0:1788612414.672293:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41689 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.672321:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788612414.672325:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+7:8445:x1875495914333312:12345-0@lo:104: Request processed in 42us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612414.672331:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788612414.672343:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612414.672349:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec074a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+6:8445:x1875495914333440:12345-0@lo:104: 00010000:00010000:2.0:1788612414.672356:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4167b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.672389:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788612414.672394:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec074a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+6:8445:x1875495914333440:12345-0@lo:104: Request processed in 46us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612414.672400:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612414.672414:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788612414.672420:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec074b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+5:8445:x1875495914333568:12345-0@lo:104: 00010000:00010000:2.0:1788612414.672556:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4166d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.672589:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788612414.672594:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec074b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+5:8445:x1875495914333568:12345-0@lo:104: Request processed in 175us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612414.672600:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788612414.672614:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788612414.672621:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+4:8445:x1875495914333696:12345-0@lo:104: 00010000:00010000:2.0:1788612414.672629:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41643 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.672655:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788612414.672661:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0748e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+4:8445:x1875495914333696:12345-0@lo:104: Request processed in 41us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612414.672667:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788612414.672679:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788612414.672685:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec074b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+3:8445:x1875495914333824:12345-0@lo:104: 00010000:00010000:2.0:1788612414.672692:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41619 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.672725:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788612414.672730:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec074b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+3:8445:x1875495914333824:12345-0@lo:104: Request processed in 47us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612414.672736:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788612414.672759:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788612414.672765:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af416cf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.672773:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612414.672777:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af416cf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.672786:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af416cf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612414.672793:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af416cf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612414.672799:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612414.672833:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af416cf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.672869:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612414.672888:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af416cf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.672895:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af416c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af416cf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.672918:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788612414.672921:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af416a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.672927:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612414.672930:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af416a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.672937:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af416a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612414.672943:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af416a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612414.672948:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612414.673685:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af416a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673692:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612414.673716:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af416a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673723:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4169e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af416a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673734:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788612414.673738:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41689 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673756:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60e00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612414.673759:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af41689 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673766:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af41689 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612414.673772:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af41689 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612414.673777:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612414.673792:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41689 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673798:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612414.673803:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41689 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673809:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e90b60e00/0xfc956d548af41682 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41689 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673817:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788612414.673821:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4167b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673826:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d6c00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612414.673829:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af4167b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673871:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af4167b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612414.673877:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af4167b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612414.673883:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612414.673898:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4167b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673903:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612414.673909:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4167b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673916:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d6c00/0xfc956d548af41674 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4167b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673925:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788612414.673928:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4166d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673933:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030600 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612414.673936:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af4166d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673942:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af4166d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612414.673949:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af4166d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612414.673970:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612414.673984:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4166d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673988:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612414.673993:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4166d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.673999:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af41666 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4166d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.674007:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788612414.674010:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41643 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.674015:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612414.674018:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af41643 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.674024:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af41643 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612414.674029:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af41643 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612414.674035:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612414.674045:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41643 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.674050:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612414.674062:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41643 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.674068:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928ec21e8000/0xfc956d548af4163c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41643 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.674077:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612414.674080:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41619 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.674086:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7a00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612414.674099:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af41619 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.674107:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af41619 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612414.674113:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af41619 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612414.674118:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612414.674133:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41619 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.674138:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612414.674142:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41619 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.674148:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d7a00/0xfc956d548af41612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41619 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612414.674162:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612414.674170:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612414.674172:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612414.674621:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914333056:0@lo:104: 00000100:00100000:0.0:1788612414.674636:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e91f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914333184:0@lo:104: 00000100:00100000:0.0:1788612414.674644:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e93b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914333312:0@lo:104: 00000100:00100000:0.0:1788612414.674652:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914333440:0@lo:104: 00000100:00100000:0.0:1788612414.674660:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914333568:0@lo:104: 00000100:00100000:0.0:1788612414.674668:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e91180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914333696:0@lo:104: 00000100:00100000:0.0:1788612414.674676:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914333824:0@lo:104: 00000100:00100000:2.0:1788612414.674737:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914334336:0@lo:103: 00000100:00100000:2.0:1788612414.674797:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612414.674932:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788612414.674939:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914333952:0@lo:103: 00000100:00100000:2.0:1788612414.674976:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612414.675030:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612414.675076:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914334208:0@lo:103: 00000100:00100000:0.0:1788612414.675123:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914334080:0@lo:103: 00000100:00100000:2.0:1788612414.677593:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914334464:0@lo:103: 00000100:00100000:2.0:1788612414.677662:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612414.678254:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334336 00000100:00100000:3.0:1788612414.678265:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334336 00010000:00010000:3.0:1788612414.678312:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e80030000/0xfc956d548af4167b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41674 expref: 19 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612414.678343:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914333952 00000100:00100000:3.0:1788612414.678347:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914333952 00010000:00010000:3.0:1788612414.678359:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ec21e8200/0xfc956d548af416cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af416c1 expref: 20 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612414.678374:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788612414.678382:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0749500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+20:3307:x1875495914334336:12345-0@lo:103: 00010000:00010000:3.0:1788612414.678396:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612414.678414:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e80030000/0xfc956d548af4167b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41674 expref: 20 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612414.678426:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e80030000/0xfc956d548af4167b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af41674 expref: 20 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612414.678455:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e80030000/0xfc956d548af4167b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af41674 expref: 20 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612414.678471:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612414.678511:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0749500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+19:3307:x1875495914334336:12345-0@lo:103: Request processed in 130us (3714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612414.678518:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788612414.678536:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788612414.678543:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0749c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+18:3307:x1875495914333952:12345-0@lo:103: 00010000:00010000:3.0:1788612414.678551:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612414.678555:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ec21e8200/0xfc956d548af416cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af416c1 expref: 18 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612414.678563:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ec21e8200/0xfc956d548af416cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af416c1 expref: 18 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612414.678573:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e8200/0xfc956d548af416cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af416c1 expref: 18 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612414.678583:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612414.678606:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0749c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+17:3307:x1875495914333952:12345-0@lo:103: Request processed in 63us (3629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612414.678612:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612414.679920:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914334336:0@lo:103: 00000100:00100000:2.0:1788612414.679947:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914333952:0@lo:103: 00000100:00100000:1.0:1788612414.680043:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612414.680064:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914334592:0@lo:103: 00000100:00100000:1.0:1788612414.680113:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612414.680141:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334464 00000100:00100000:1.0:1788612414.680147:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334464 00010000:00010000:1.0:1788612414.680172:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e80030c00/0xfc956d548af4166d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41666 expref: 17 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612414.680203:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334080 00000100:00100000:1.0:1788612414.680207:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334080 00010000:00010000:1.0:1788612414.680219:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e910d7c00/0xfc956d548af416a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af4169e expref: 18 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612414.680228:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334592 00000100:00100000:1.0:1788612414.680230:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334592 00010000:00010000:1.0:1788612414.680238:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e910d7e00/0xfc956d548af41643 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af4163c expref: 19 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612414.680251:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788612414.680257:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0302680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+19:3307:x1875495914334464:12345-0@lo:103: 00010000:00010000:1.0:1788612414.680268:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612414.680273:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e80030c00/0xfc956d548af4166d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41666 expref: 19 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.680282:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e80030c00/0xfc956d548af4166d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af41666 expref: 19 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.680312:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e80030c00/0xfc956d548af4166d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af41666 expref: 19 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.680326:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612414.680367:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0302680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+18:3307:x1875495914334464:12345-0@lo:103: Request processed in 110us (2704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612414.680374:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788612414.680389:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788612414.680395:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+17:3305:x1875495914334080:12345-0@lo:103: 00010000:00010000:1.0:1788612414.680403:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612414.680407:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e910d7c00/0xfc956d548af416a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af4169e expref: 17 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.680414:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e910d7c00/0xfc956d548af416a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af4169e expref: 17 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.680423:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e910d7c00/0xfc956d548af416a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af4169e expref: 17 pid: 5847 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.680444:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612414.680471:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+16:3305:x1875495914334080:12345-0@lo:103: Request processed in 76us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612414.680477:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788612414.680489:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788612414.680494:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+15:3305:x1875495914334592:12345-0@lo:103: 00010000:00010000:1.0:1788612414.680502:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612414.680506:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e910d7e00/0xfc956d548af41643 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af4163c expref: 15 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.680520:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e910d7e00/0xfc956d548af41643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af4163c expref: 15 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.680530:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e910d7e00/0xfc956d548af41643 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af4163c expref: 15 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.680537:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612414.680559:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+14:3305:x1875495914334592:12345-0@lo:103: Request processed in 65us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612414.680564:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788612414.680591:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914334080:0@lo:103: 00000100:00100000:1.0:1788612414.680599:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914334592:0@lo:103: 00000100:00100000:1.0:1788612414.680619:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612414.680636:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914334720:0@lo:103: 00000100:00100000:1.0:1788612414.680657:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612414.680673:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334208 00000100:00100000:1.0:1788612414.680675:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334208 00010000:00010000:1.0:1788612414.680687:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e90b60600/0xfc956d548af41689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41682 expref: 14 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612414.680905:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334720 00000100:00100000:1.0:1788612414.680908:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334720 00010000:00010000:1.0:1788612414.680920:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e90b61e00/0xfc956d548af41619 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41612 expref: 15 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612414.680931:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788612414.680937:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0996300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+15:3306:x1875495914334208:12345-0@lo:103: 00010000:00010000:1.0:1788612414.680952:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612414.680956:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e90b60600/0xfc956d548af41689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41682 expref: 15 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.680964:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e90b60600/0xfc956d548af41689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af41682 expref: 15 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.680973:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b60600/0xfc956d548af41689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af41682 expref: 15 pid: 5846 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.680983:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612414.681010:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0996300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+14:3306:x1875495914334208:12345-0@lo:103: Request processed in 73us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612414.681017:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788612414.681030:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788612414.681036:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9238d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+13:3306:x1875495914334720:12345-0@lo:103: 00010000:00010000:1.0:1788612414.681043:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612414.681047:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e90b61e00/0xfc956d548af41619 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41612 expref: 13 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.681054:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e90b61e00/0xfc956d548af41619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af41612 expref: 13 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.681063:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b61e00/0xfc956d548af41619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af41612 expref: 13 pid: 5844 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612414.681071:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612414.681104:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9238d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+12:3306:x1875495914334720:12345-0@lo:103: Request processed in 67us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612414.681109:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788612414.681161:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914334208:0@lo:103: 00000100:00100000:1.0:1788612414.681169:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914334720:0@lo:103: 00000100:00100000:2.0:1788612414.681308:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914334464:0@lo:103: 00000100:00100000:0.0:1788612414.682383:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e93100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914332800:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612414.682396:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1875495914332928:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612414.682445:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612414.682579:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612414.682614:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612414.682674:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893340160 00000100:00100000:0.0:1788612414.682680:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893340160 00010000:00010000:0.0:1788612414.682768:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e80031800/0xfc956d548af416e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd776 expref: 10 pid: 5846 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612414.682814:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893340288 00000100:00100000:0.0:1788612414.682818:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893340288 00010000:00010000:0.0:1788612414.682853:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e90b61a00/0xfc956d548af416dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd76f expref: 11 pid: 5844 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612414.682870:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:0.0:1788612414.682878:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0302680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93581484-5c48-42e2-a9bb-7e5e07222f81+11:2356:x1875495893340160:12345-192.168.202.6@tcp:103: 00010000:00010000:0.0:1788612414.682890:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612414.682895:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e80031800/0xfc956d548af416e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd776 expref: 11 pid: 5846 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.682905:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e80031800/0xfc956d548af416e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd776 expref: 11 pid: 5846 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.682921:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e80031800/0xfc956d548af416e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd776 expref: 11 pid: 5846 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.682936:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612414.682979:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0302680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2356:x1875495893340160:12345-192.168.202.6@tcp:103: Request processed in 102us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612414.682986:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:0.0:1788612414.683003:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:0.0:1788612414.683010:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0748a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93581484-5c48-42e2-a9bb-7e5e07222f81+9:2356:x1875495893340288:12345-192.168.202.6@tcp:103: 00010000:00010000:0.0:1788612414.683018:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612414.683022:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e90b61a00/0xfc956d548af416dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd76f expref: 9 pid: 5844 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.683043:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e90b61a00/0xfc956d548af416dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd76f expref: 9 pid: 5844 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.683053:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b61a00/0xfc956d548af416dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd76f expref: 9 pid: 5844 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.683066:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.683076:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.683104:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.683112:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.683119:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.683127:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.683133:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612414.683138:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.683147:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.683172:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.683270:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612414.683290:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0748a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93581484-5c48-42e2-a9bb-7e5e07222f81+8:2356:x1875495893340288:12345-192.168.202.6@tcp:103: Request processed in 281us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612414.683296:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00010000:00010000:0.0:1788612414.683319:0:8445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.683326:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612414.683333:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e910d7400/0xfc956d548af4171c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612415.096002:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612415.674135:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612415.674213:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893340416 00000100:00100000:2.0:1788612415.674224:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893340416 00000100:00100000:2.0:1788612415.674287:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:2.0:1788612415.674298:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+8:5596:x1875495893340416:12345-192.168.202.6@tcp:101: 00010000:00010000:2.0:1788612415.674313:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612415.674332:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e8000/0xfc956d548af41723 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd7d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612415.674359:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e8000/0xfc956d548af41723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7d8 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612415.674381:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e8000/0xfc956d548af41723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7d8 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612415.674413:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8000, rc 0) 00000100:00100000:2.0:1788612415.674492:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+9:5596:x1875495893340416:12345-192.168.202.6@tcp:101: Request processed in 195us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612415.674499:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:1.0:1788612415.678426:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612415.678533:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893340544 00000100:00100000:0.0:1788612415.678543:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893340544 00000100:00100000:0.0:1788612415.678668:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 132 00000100:00100000:0.0:1788612415.678680:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+9:5596:x1875495893340544:12345-192.168.202.6@tcp:501: 00000100:00100000:0.0:1788612415.681327:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+9:5596:x1875495893340544:12345-192.168.202.6@tcp:501: Request processed in 2635us (2896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612415.681343:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 132 00000100:00100000:3.0:1788612415.693339:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612415.693775:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893340672 00000100:00100000:1.0:1788612415.693787:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893340672 00000100:00100000:1.0:1788612415.693870:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 133 00000100:00100000:1.0:1788612415.693882:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+9:5596:x1875495893340672:12345-192.168.202.6@tcp:503: 00000100:00100000:1.0:1788612415.694137:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+9:5596:x1875495893340672:12345-192.168.202.6@tcp:503: Request processed in 256us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612415.694145:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 133 00000100:00100000:1.0:1788612415.710993:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612415.711567:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893340800 00000100:00100000:0.0:1788612415.711578:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893340800 00000100:00100000:0.0:1788612415.711638:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 134 00000100:00100000:0.0:1788612415.711650:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+9:6063:x1875495893340800:12345-192.168.202.6@tcp:502: 00000100:00100000:0.0:1788612415.711997:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+9:6063:x1875495893340800:12345-192.168.202.6@tcp:502: Request processed in 348us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612415.712006:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 134 00000100:00100000:3.0:1788612415.718948:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612415.719245:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893340928 00000100:00100000:2.0:1788612415.719255:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893340928 00000100:00100000:2.0:1788612415.719319:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 135 00000100:00100000:2.0:1788612415.719330:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+9:6063:x1875495893340928:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612415.719640:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+9:6063:x1875495893340928:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 311us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612415.719649:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 135 00000100:00100000:3.0:1788612415.726872:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612415.727147:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893341056 00000100:00100000:1.0:1788612415.727158:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893341056 00000100:00100000:1.0:1788612415.727218:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:1.0:1788612415.727228:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+9:5596:x1875495893341056:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612415.727245:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612415.727265:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b60a00/0xfc956d548af4172a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd7df expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612415.727295:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b60a00/0xfc956d548af4172a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7df expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612415.727306:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b60a00/0xfc956d548af4172a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7df expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612415.727315:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60a00, rc 0) 00000100:00100000:1.0:1788612415.727394:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5596:x1875495893341056:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 167us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612415.727401:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:1.0:1788612415.734454:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612415.734626:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893341184 00000100:00100000:0.0:1788612415.734637:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893341184 00000100:00100000:0.0:1788612415.734712:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00100000:0.0:1788612415.734723:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5596:x1875495893341184:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612415.735068:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5596:x1875495893341184:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 347us (624us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788612415.735077:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00100000:3.0:1788612415.935592:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612415.935639:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612415.935671:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612415.935763:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893341568 00000100:00100000:1.0:1788612415.935775:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893341568 00000100:00100000:0.0:1788612415.935813:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893341312 00000100:00100000:0.0:1788612415.935819:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893341312 00000100:00100000:1.0:1788612415.935889:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893341440 00000100:00100000:1.0:1788612415.935894:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893341440 00000100:00100000:0.0:1788612415.935908:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:1.0:1788612415.935919:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:1.0:1788612415.935929:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2354:x1875495893341568:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612415.935942:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2354:x1875495893341312:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612415.936039:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788612415.936050:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788612415.936170:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:2.0:1788612415.936189:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2354:x1875495893341440:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612415.936252:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2354:x1875495893341568:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 324us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612415.936259:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00080000:3.0:1788612415.936399:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788612415.936753:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612415.936756:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612415.936865:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2354:x1875495893341312:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 944us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612415.936874:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:2.0:1788612415.937531:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2354:x1875495893341440:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 1349us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612415.937541:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00010000:00010000:1.0:1788612416.108116:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788612416.302174:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788612416.302184:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff928d85299000 from 39 10000000:01000000:0.0:1788612416.302191:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788612416.302243:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.302256:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.302267:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612416.302328:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914334848:0@lo:101: 00000100:00100000:0.0:1788612416.302411:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612416.302638:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334848 00000100:00100000:3.0:1788612416.302645:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334848 00000100:00100000:3.0:1788612416.302705:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788612416.302716:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+12:5849:x1875495914334848:12345-0@lo:101: 00010000:00010000:3.0:1788612416.302729:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612416.302743:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea0145400/0xfc956d548af41738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41731 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.302768:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea0145400/0xfc956d548af41738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41731 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.302779:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea0145400/0xfc956d548af41738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41731 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.302788:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0145400, rc 0) 00000100:00100000:3.0:1788612416.302857:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+13:5849:x1875495914334848:12345-0@lo:101: Request processed in 124us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.302864:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788612416.303808:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e9110b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612416.303866:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914334848:0@lo:101: 00010000:00010000:0.0:1788612416.303889:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41738 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.303900:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41738 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612416.303982:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914334976:0@lo:501: 00000100:00100000:0.0:1788612416.304026:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.304064:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e9110b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612416.304939:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914334976 00000100:00100000:3.0:1788612416.304949:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914334976 00000100:00100000:3.0:1788612416.305010:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788612416.305021:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:5849:x1875495914334976:12345-0@lo:501: 00000100:00100000:3.0:1788612416.305359:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:5849:x1875495914334976:12345-0@lo:501: Request processed in 338us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.305367:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788612416.307245:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914334976:0@lo:501: 00000100:00100000:0.0:1788612416.307327:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914335104:0@lo:503: 00000100:00100000:0.0:1788612416.307419:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.307590:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e9110b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612416.308280:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914335104 00000100:00100000:3.0:1788612416.308295:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914335104 00000100:00100000:3.0:1788612416.308358:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788612416.308367:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:5849:x1875495914335104:12345-0@lo:503: 00000100:00100000:3.0:1788612416.308797:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:5849:x1875495914335104:12345-0@lo:503: Request processed in 430us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.308804:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788612416.309222:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914335104:0@lo:503: 00000100:00100000:0.0:1788612416.310031:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8471:1875495914335232:0@lo:502: 00000100:00100000:0.0:1788612416.310121:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.310164:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e9110b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612416.310221:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914335232 00000100:00100000:3.0:1788612416.310227:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914335232 00000100:00100000:3.0:1788612416.310280:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788612416.310289:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+13:8471:x1875495914335232:12345-0@lo:502: 00000100:00100000:3.0:1788612416.310572:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+13:8471:x1875495914335232:12345-0@lo:502: Request processed in 283us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.310579:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788612416.313159:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8471:1875495914335232:0@lo:502: 00000100:00100000:0.0:1788612416.313247:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8471:1875495914335360:0@lo:502: 00000100:00100000:0.0:1788612416.313355:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612416.313575:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914335360 00000100:00100000:3.0:1788612416.313583:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914335360 00000100:00100000:3.0:1788612416.313635:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788612416.313645:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:8471:x1875495914335360:12345-0@lo:502: 00000100:00100000:3.0:1788612416.329726:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+13:8471:x1875495914335360:12345-0@lo:502: Request processed in 16071us (16359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.329744:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788612416.337166:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e87104180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612416.337226:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8471:1875495914335360:0@lo:502: 00000040:00080000:0.0:1788612416.337305:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788612416.338040:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788612416.338063:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788612416.338084:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41738 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.338096:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41738 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612416.338107:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788612416.338109:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788612416.338113:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788612416.338163:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.338171:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.338180:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612416.338204:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914335488:0@lo:101: 00000100:00100000:0.0:1788612416.338546:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.338591:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e87104180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612416.338615:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914335488 00000100:00100000:0.0:1788612416.338622:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914335488 00000100:00100000:0.0:1788612416.338764:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788612416.338776:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+13:5849:x1875495914335488:12345-0@lo:101: 00010000:00010000:0.0:1788612416.338790:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612416.338802:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e910d7800/0xfc956d548af41746 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af4173f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.338832:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e910d7800/0xfc956d548af41746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af4173f expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.338865:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e910d7800/0xfc956d548af41746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4173f expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.338874:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d7800, rc 0) 00000100:00100000:0.0:1788612416.338916:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914335488:12345-0@lo:101: Request processed in 142us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612416.338923:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788612416.338964:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914335488:0@lo:101: 00010000:00010000:0.0:1788612416.338978:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41746 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.338987:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41746 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612416.340963:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914335616:0@lo:501: 00000100:00100000:0.0:1788612416.342917:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.342960:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e87104180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612416.349582:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914335616 00000100:00100000:1.0:1788612416.349597:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914335616 00000100:00100000:1.0:1788612416.349666:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788612416.349686:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914335616:12345-0@lo:501: 00000100:00100000:1.0:1788612416.350022:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914335616:12345-0@lo:501: Request processed in 345us (7110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612416.350031:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788612416.353729:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914335616:0@lo:501: 00000100:00100000:0.0:1788612416.353793:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914335744:0@lo:503: 00000100:00100000:0.0:1788612416.353897:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.353938:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e87104180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612416.355939:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914335744 00000100:00100000:1.0:1788612416.355955:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914335744 00000100:00100000:1.0:1788612416.356024:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788612416.356035:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914335744:12345-0@lo:503: 00000100:00100000:1.0:1788612416.356817:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914335744:12345-0@lo:503: Request processed in 781us (2918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612416.356881:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788612416.356966:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914335744:0@lo:503: 00000100:00100000:1.0:1788612416.357193:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8472:1875495914335872:0@lo:502: 00000100:00100000:1.0:1788612416.357242:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612416.357278:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914335872 00000100:00100000:1.0:1788612416.357283:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914335872 00000100:00100000:1.0:1788612416.357316:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788612416.357324:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+14:8472:x1875495914335872:12345-0@lo:502: 00000100:00100000:0.0:1788612416.357623:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e98c45180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612416.360762:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+14:8472:x1875495914335872:12345-0@lo:502: Request processed in 3428us (3509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612416.360778:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788612416.360954:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8472:1875495914335872:0@lo:502: 00000020:01000000:0.0:1788612416.360990:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612416.361001:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612416.361003:0:8472:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788612416.361011:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788612416.361052:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e93100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8472:1875495914336000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612416.361118:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.361148:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e87104180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612416.364203:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336000 00000100:00100000:1.0:1788612416.364219:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336000 00000100:00100000:1.0:1788612416.364293:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788612416.364311:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+14:8472:x1875495914336000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612416.365789:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+14:8472:x1875495914336000:12345-0@lo:502:llog_process_th.0 Request processed in 1474us (4664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612416.365801:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788612416.365983:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e93100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8472:1875495914336000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788612416.366018:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612416.366026:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612416.366028:0:8472:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788612416.366034:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788612416.367568:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788612416.367601:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788612416.367616:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41746 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612416.367628:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41746 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612416.367662:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788612416.367664:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff928e9162f000 from 39 10000000:01000000:1.0:1788612416.367667:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788612416.367713:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612416.367722:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612416.367733:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612416.367758:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0996300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914336128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788612416.367821:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612416.367918:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e98c450c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612416.368906:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336128 00000100:00100000:2.0:1788612416.368918:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336128 00000100:00100000:2.0:1788612416.368976:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788612416.368986:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+14:5849:x1875495914336128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612416.368999:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612416.369014:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e9400/0xfc956d548af41754 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af4174d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612416.369049:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e9400/0xfc956d548af41754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af4174d expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612416.369060:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e9400/0xfc956d548af41754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4174d expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612416.369069:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9400, rc 0) 00000100:00100000:2.0:1788612416.369143:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914336128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612416.369150:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788612416.370140:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0996300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914336128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612416.370165:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612416.370176:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612416.370246:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0996300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914336256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612416.372673:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.372730:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e98c450c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612416.372976:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336256 00000100:00100000:1.0:1788612416.372985:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336256 00000100:00100000:1.0:1788612416.373044:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788612416.373053:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914336256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612416.373387:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914336256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612416.373395:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788612416.373519:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0996300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914336256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612416.373570:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914336384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612416.373614:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.373645:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e87104180 going to sleep for 11 seconds 00000100:00100000:3.0:1788612416.373758:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336384 00000100:00100000:3.0:1788612416.373762:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336384 00000100:00100000:3.0:1788612416.373793:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788612416.373808:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914336384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612416.373983:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914336384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.373990:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788612416.374672:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914336384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612416.378783:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8473:1875495914336512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612416.378914:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612416.378971:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacf91840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612416.379098:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336512 00000100:00100000:3.0:1788612416.379106:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336512 00000100:00100000:3.0:1788612416.379154:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788612416.379164:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+15:8473:x1875495914336512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612416.379452:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+15:8473:x1875495914336512:12345-0@lo:502:llog_process_th.0 Request processed in 288us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612416.379979:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8473:1875495914336512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612416.380041:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e93100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8473:1875495914336640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612416.380101:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.380125:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e87104180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612416.380264:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336640 00000100:00100000:1.0:1788612416.380279:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336640 00000100:00100000:1.0:1788612416.380307:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788612416.380315:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:8473:x1875495914336640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612416.381710:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:8473:x1875495914336640:12345-0@lo:502:llog_process_th.0 Request processed in 1388us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612416.381725:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788612416.381873:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e93100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8473:1875495914336640:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788612416.381910:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:3.0:1788612416.382227:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000020:01000000:0.0:1788612416.382694:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788612416.382716:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788612416.382727:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.382738:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612416.382749:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788612416.382752:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788612416.382755:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788612416.382791:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.382799:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.382808:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612416.382830:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914336768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612416.383347:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.383395:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e9a995540 going to sleep for 11 seconds 00000100:00100000:3.0:1788612416.383467:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336768 00000100:00100000:3.0:1788612416.383475:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336768 00000100:00100000:3.0:1788612416.383522:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788612416.383531:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+15:5849:x1875495914336768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612416.383545:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612416.383559:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea0145200/0xfc956d548af41762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af4175b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.383583:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea0145200/0xfc956d548af41762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af4175b expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.383594:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea0145200/0xfc956d548af41762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4175b expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.383603:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0145200, rc 0) 00000100:00100000:3.0:1788612416.383639:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914336768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.383655:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788612416.383737:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914336768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612416.383758:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41762 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.383767:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41762 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612416.383816:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914336896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612416.383867:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.383882:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e9a995540 going to sleep for 11 seconds 00000100:00100000:3.0:1788612416.383926:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914336896 00000100:00100000:3.0:1788612416.383931:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914336896 00000100:00100000:3.0:1788612416.383960:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788612416.383967:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914336896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612416.384241:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914336896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.384249:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788612416.384326:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914336896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612416.384359:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914337024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612416.384397:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.384422:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e9a995540 going to sleep for 11 seconds 00000100:00100000:3.0:1788612416.384469:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337024 00000100:00100000:3.0:1788612416.384473:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337024 00000100:00100000:3.0:1788612416.384504:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788612416.384511:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914337024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612416.384676:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914337024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.384683:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788612416.384757:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914337024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612416.385293:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8474:1875495914337152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612416.385346:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612416.385377:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a55780 going to sleep for 11 seconds 00000100:00100000:0.0:1788612416.385426:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337152 00000100:00100000:0.0:1788612416.385431:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337152 00000100:00100000:0.0:1788612416.385475:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788612416.385483:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+16:8474:x1875495914337152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612416.385636:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+16:8474:x1875495914337152:12345-0@lo:502:llog_process_th.0 Request processed in 154us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612416.385643:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788612416.385887:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8474:1875495914337152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612416.385916:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612416.385925:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612416.385927:0:8474:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788612416.385932:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788612416.385955:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8474:1875495914337280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612416.385990:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612416.386013:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a55780 going to sleep for 11 seconds 00000100:00100000:0.0:1788612416.386123:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337280 00000100:00100000:0.0:1788612416.386128:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337280 00000100:00100000:0.0:1788612416.386150:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788612416.386156:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+16:8474:x1875495914337280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612416.386280:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+16:8474:x1875495914337280:12345-0@lo:502:llog_process_th.0 Request processed in 123us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612416.386286:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788612416.386616:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8474:1875495914337280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612416.386636:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612416.386641:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612416.386643:0:8474:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788612416.386647:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788612416.386807:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788612416.386827:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788612416.386878:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41762 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.386890:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41762 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612416.386900:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788612416.386903:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff928e98e67000 from 39 10000000:01000000:0.0:1788612416.386905:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788612416.386930:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.386936:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.386944:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612416.386958:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914337408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612416.386988:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.387007:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e9110b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612416.387093:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337408 00000100:00100000:3.0:1788612416.387099:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337408 00000100:00100000:3.0:1788612416.387125:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788612416.387132:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914337408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612416.387141:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612416.387154:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea0145a00/0xfc956d548af41770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41769 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.387177:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea0145a00/0xfc956d548af41770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41769 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.387187:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea0145a00/0xfc956d548af41770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41769 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.387196:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0145a00, rc 0) 00000100:00100000:3.0:1788612416.387225:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914337408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.387231:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788612416.388556:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914337408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612416.388580:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612416.388598:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612416.388666:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914337536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612416.388717:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.388753:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e9110b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612416.388772:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337536 00000100:00100000:0.0:1788612416.388777:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337536 00000100:00100000:0.0:1788612416.388811:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788612416.388820:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914337536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612416.389093:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914337536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612416.389101:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788612416.389128:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914337536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612416.389157:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914337664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612416.389197:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.389211:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e9110b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612416.389228:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337664 00000100:00100000:0.0:1788612416.389231:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337664 00000100:00100000:0.0:1788612416.389248:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788612416.389253:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914337664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612416.389397:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914337664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612416.389404:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788612416.389440:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914337664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612416.396387:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8475:1875495914337792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612416.396728:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.396775:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e9110b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612416.396822:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337792 00000100:00100000:2.0:1788612416.396830:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337792 00000100:00100000:2.0:1788612416.396903:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788612416.396913:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+17:8475:x1875495914337792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612416.397174:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+17:8475:x1875495914337792:12345-0@lo:502:llog_process_th.0 Request processed in 262us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612416.397182:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788612416.397511:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8475:1875495914337792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612416.397570:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8475:1875495914337920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612416.397613:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612416.397645:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e922aee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612416.397756:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914337920 00000100:00100000:3.0:1788612416.397762:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914337920 00000100:00100000:3.0:1788612416.397803:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788612416.397811:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+17:8475:x1875495914337920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612416.397999:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+17:8475:x1875495914337920:12345-0@lo:502:llog_process_th.0 Request processed in 189us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.398013:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788612416.399823:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8475:1875495914337920:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788612416.399897:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788612416.400204:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788612416.400223:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788612416.400232:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612416.400254:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612416.400265:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788612416.400267:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788612416.400271:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788612416.400320:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612416.400328:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612416.400337:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612416.400357:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914338048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612416.400431:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612416.400484:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacf916c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612416.400533:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338048 00000100:00100000:3.0:1788612416.400542:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338048 00000100:00100000:3.0:1788612416.400596:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788612416.400605:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914338048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612416.400617:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612416.400629:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e80031800/0xfc956d548af4177e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41777 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.400651:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e80031800/0xfc956d548af4177e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41777 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.400661:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e80031800/0xfc956d548af4177e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41777 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.400669:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80031800, rc 0) 00000100:00100000:3.0:1788612416.400706:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914338048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.400712:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788612416.401009:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914338048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612416.401023:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612416.401030:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612416.401087:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914338176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612416.401119:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612416.401155:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacf916c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612416.401199:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338176 00000100:00100000:3.0:1788612416.401205:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338176 00000100:00100000:3.0:1788612416.401236:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788612416.401243:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914338176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612416.401536:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914338176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.401544:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788612416.403106:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914338176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612416.403169:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914338304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612416.403234:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612416.403269:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacf916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612416.403551:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338304 00000100:00100000:1.0:1788612416.403559:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338304 00000100:00100000:1.0:1788612416.403607:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788612416.403616:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914338304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612416.403816:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914338304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612416.403823:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788612416.405790:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914338304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612416.410338:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8477:1875495914338432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612416.410430:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612416.410468:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a55240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612416.411211:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338432 00000100:00100000:2.0:1788612416.411224:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338432 00000100:00100000:2.0:1788612416.411276:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788612416.411287:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:8477:x1875495914338432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612416.425451:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:8477:x1875495914338432:12345-0@lo:502:llog_process_th.0 Request processed in 14155us (15010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.425566:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8477:1875495914338432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612416.425618:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612416.425631:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612416.425633:0:8477:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788612416.425639:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788612416.425680:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8477:1875495914338560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612416.425754:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612416.425787:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a55240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612416.426668:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788612416.426729:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338560 00000100:00100000:2.0:1788612416.426737:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338560 00000100:00100000:2.0:1788612416.426781:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788612416.426789:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:8477:x1875495914338560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612416.431830:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:8477:x1875495914338560:12345-0@lo:502:llog_process_th.0 Request processed in 5032us (6065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612416.431861:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788612416.431902:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8477:1875495914338560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612416.431943:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612416.431951:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612416.431953:0:8477:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788612416.431959:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788612416.432408:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788612416.432430:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788612416.432441:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612416.432452:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612416.432487:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788612416.432489:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff928e90d3b380 from 1 10000000:01000000:2.0:1788612416.432492:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788612416.432525:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9c00/0xfc956d548af41785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612416.432534:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ec21e9c00/0xfc956d548af41785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612416.432543:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ec21e9c00/0xfc956d548af41785 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612416.432566:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914338688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612416.432610:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612416.432644:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacf91e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612416.432761:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338688 00000100:00100000:3.0:1788612416.432769:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338688 00000100:00100000:3.0:1788612416.432815:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788612416.432825:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914338688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612416.432865:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612416.432878:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e80030c00/0xfc956d548af4178c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41785 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.432904:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e80030c00/0xfc956d548af4178c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41785 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.432914:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e80030c00/0xfc956d548af4178c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41785 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.432943:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030c00, rc 0) 00000100:00100000:3.0:1788612416.432983:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914338688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.432989:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788612416.433041:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914338688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612416.433055:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ec21e9c00/0xfc956d548af41785 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4178c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612416.433063:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ec21e9c00/0xfc956d548af41785 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4178c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612416.433126:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914338816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612416.433151:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612416.433163:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a55b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612416.434183:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338816 00000100:00100000:2.0:1788612416.434195:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338816 00000100:00100000:2.0:1788612416.434245:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788612416.434254:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914338816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612416.434907:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914338816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 653us (1752us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788612416.434917:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788612416.436903:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914338816:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788612416.436950:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788612416.436960:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9c00/0xfc956d548af41785 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4178c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612416.436971:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ec21e9c00/0xfc956d548af41785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4178c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612416.556646:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914338944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612416.556717:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612416.557022:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914338944 00000100:00100000:3.0:1788612416.557031:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914338944 00000100:00100000:3.0:1788612416.557099:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788612416.557109:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914338944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612416.557147:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612416.557204:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914338944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612416.557211:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788612416.557253:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef7100 x1875495914338944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612416.557271:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914338944:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788612416.557481:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788612416.998183:0:8506:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1c474ed0 20000000:00000080:1.0:1788612416.998199:0:8506:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff928ea773c400 uarg=0000000000000000 20000000:01000000:1.0:1788612416.998237:0:8506:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788612416.998243:0:8506:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788612416.998252:0:8506:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788612417.006262:0:8507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788612417.006859:0:8506:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788612417.009662:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788612417.009717:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788612417.009762:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788612417.009778:0:8506:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788612417.009796:0:8506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.009814:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ec21e9200/0xfc956d548af41508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41501 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.009822:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ec21e8400/0xfc956d548af4156a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41563 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.009830:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e80030400/0xfc956d548af41635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4162e expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.009881:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e90b60800/0xfc956d548af416f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7a7 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.009889:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.009933:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e90b60800/0xfc956d548af416f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7a7 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.009948:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928e90b60800/0xfc956d548af416f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7a7 expref: 9 pid: 5847 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612417.009960:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875495914339072:192.168.202.6@tcp:104: 00010000:00010000:3.0:1788612417.010050:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e80030400/0xfc956d548af41635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af4162e expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.010064:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e80030400/0xfc956d548af41635 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af4162e expref: 18 pid: 5844 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612417.016303:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875495914339200:0@lo:104: 00000100:00100000:3.0:1788612417.016384:0:8506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612417.016456:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:3.0:1788612417.016460:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ec21e8400/0xfc956d548af4156a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af41563 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.016473:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928ec21e8400/0xfc956d548af4156a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af41563 expref: 18 pid: 5846 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612417.016483:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875495914339328:0@lo:104: 00000100:00100000:3.0:1788612417.016517:0:8506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612417.016522:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893341696 00000100:00100000:0.0:1788612417.016533:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893341696 00010000:00010000:0.0:1788612417.016578:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e90b60800/0xfc956d548af416f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7a7 expref: 10 pid: 5847 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612417.016615:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:0.0:1788612417.016624:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0997480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2356:x1875495893341696:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612417.016637:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612417.016643:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e90b60800/0xfc956d548af416f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7a7 expref: 10 pid: 5847 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.016655:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e90b60800/0xfc956d548af416f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7a7 expref: 10 pid: 5847 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.016689:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612417.016734:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0997480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2356:x1875495893341696:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 109us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612417.016759:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00010000:00010000:3.0:1788612417.016861:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ec21e9200/0xfc956d548af41508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af41501 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.016871:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928ec21e9200/0xfc956d548af41508 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af41501 expref: 18 pid: 5847 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612417.016880:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c50700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875495914339456:0@lo:104: 00000100:00100000:3.0:1788612417.016908:0:8506:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a55000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612417.016922:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1788612417.016929:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b60800/0xfc956d548af416f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7a7 expref: 9 pid: 5847 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612417.016941:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612417.016943:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875495914339072:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612417.016963:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914339200 00000100:00100000:1.0:1788612417.016967:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914339200 00000100:00100000:1.0:1788612417.016987:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914339328 00000100:00100000:1.0:1788612417.016989:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914339328 00000100:00100000:1.0:1788612417.016998:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914339456 00000100:00100000:1.0:1788612417.016999:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914339456 00000100:00100000:1.0:1788612417.017009:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612417.017015:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+5:8506:x1875495914339200:12345-0@lo:104: 00010000:00010000:1.0:1788612417.017026:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41635 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612417.017081:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788612417.017086:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+5:8506:x1875495914339200:12345-0@lo:104: Request processed in 72us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612417.017093:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612417.017108:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788612417.017113:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc99850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+4:8506:x1875495914339328:12345-0@lo:104: 00010000:00010000:1.0:1788612417.017120:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4156a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612417.017149:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788612417.017154:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc99850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+4:8506:x1875495914339328:12345-0@lo:104: Request processed in 42us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612417.017160:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788612417.017201:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788612417.017208:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0997100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+3:8506:x1875495914339456:12345-0@lo:104: 00010000:00010000:2.0:1788612417.017211:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612417.017215:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928ea0145c00/0xfc956d548af41501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41508 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612417.017218:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41635 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612417.017231:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7200 already unused, calling callback (ffffffffc1a10c20) 00010000:00010000:1.0:1788612417.017239:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788612417.017244:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0997100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+3:8506:x1875495914339456:12345-0@lo:104: Request processed in 37us (303us total) trans 0 rc 0/0 10000000:00010000:2.0:1788612417.017245:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af41635 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612417.017249:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788612417.017254:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af41635 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612417.017261:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af41635 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612417.017266:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788612417.017291:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41635 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612417.017297:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612417.017317:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41635 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612417.017323:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af4162e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41635 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612417.017332:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788612417.017343:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4156a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612417.017349:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8e00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612417.017352:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af4156a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612417.017369:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af4156a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612417.017375:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af4156a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612417.017380:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788612417.017395:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4156a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612417.017400:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612417.017426:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4156a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612417.017433:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928ec21e8e00/0xfc956d548af41563 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4156a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612417.017442:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612417.017445:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928ea0145c00/0xfc956d548af41501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41508 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612417.017451:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0145c00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612417.017454:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928ea0145c00/0xfc956d548af41501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af41508 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612417.017460:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928ea0145c00/0xfc956d548af41501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af41508 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612417.017466:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928ea0145c00/0xfc956d548af41501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af41508 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612417.017476:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788612417.017489:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928ea0145c00/0xfc956d548af41501 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41508 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612417.017503:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612417.017509:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928ea0145c00/0xfc956d548af41501 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41508 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612417.017515:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928ea0145c00/0xfc956d548af41501 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41508 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612417.017524:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612417.017719:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612417.017722:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612417.017724:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612417.017737:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914339584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612417.017766:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612417.017800:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914339584 00000100:00100000:0.0:1788612417.017806:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914339584 00000100:00100000:2.0:1788612417.017809:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914339712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612417.017822:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e80030400/0xfc956d548af41635 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af4162e expref: 19 pid: 5844 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612417.017829:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612417.017955:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875495914339200:0@lo:104: 00000100:00100000:3.0:1788612417.017963:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875495914339328:0@lo:104: 00000100:00100000:3.0:1788612417.017978:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c50700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875495914339456:0@lo:104: 00010000:00010000:3.0:1788612417.018013:0:8506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612417.019423:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914339840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612417.020970:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612417.022807:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914339712 00000100:00100000:0.0:1788612417.022822:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914339712 00010000:00010000:0.0:1788612417.022876:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ec21e8400/0xfc956d548af4156a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41563 expref: 20 pid: 5846 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612417.022905:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914339840 00000100:00100000:0.0:1788612417.022908:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914339840 00010000:00010000:0.0:1788612417.022920:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ec21e9200/0xfc956d548af41508 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41501 expref: 21 pid: 5847 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612417.022934:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788612417.022943:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0748000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+21:3308:x1875495914339584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612417.022957:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612417.022963:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e80030400/0xfc956d548af41635 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af4162e expref: 21 pid: 5844 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.022976:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e80030400/0xfc956d548af41635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af4162e expref: 21 pid: 5844 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.022995:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e80030400/0xfc956d548af41635 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af4162e expref: 21 pid: 5844 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.023012:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612417.023088:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0748000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+20:3308:x1875495914339584:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (5320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612417.023110:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788612417.023128:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788612417.023134:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec074a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914339712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612417.023141:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612417.023146:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ec21e8400/0xfc956d548af4156a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41563 expref: 19 pid: 5846 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.023154:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ec21e8400/0xfc956d548af4156a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af41563 expref: 19 pid: 5846 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.023164:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e8400/0xfc956d548af4156a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af41563 expref: 19 pid: 5846 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.023173:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612417.023200:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec074a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+18:3305:x1875495914339712:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (5370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612417.023205:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788612417.023217:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788612417.023223:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+17:3306:x1875495914339840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612417.023229:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612417.023233:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ec21e9200/0xfc956d548af41508 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41501 expref: 17 pid: 5847 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.023240:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ec21e9200/0xfc956d548af41508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af41501 expref: 17 pid: 5847 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.023250:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e9200/0xfc956d548af41508 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af41501 expref: 17 pid: 5847 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.023269:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612417.023275:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914339584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612417.023278:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.023291:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612417.023302:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914339712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612417.023504:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.023513:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.023520:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.023526:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612417.023531:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.023539:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.023561:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612417.023572:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612417.023609:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+16:3306:x1875495914339840:12345-0@lo:103:ldlm_bl.0 Request processed in 386us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612417.023624:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612417.023655:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914339840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612417.024495:0:8506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612417.024507:0:8506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612417.024514:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e80030600/0xfc956d548af41793 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612417.068177:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914339968:0@lo:400:kworker.0 00000100:00100000:3.0:1788612417.068246:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612417.068284:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612417.068289:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914340096:0@lo:400:kworker.0 00000100:00100000:3.0:1788612417.068307:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612417.068344:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914339968 00000100:00100000:3.0:1788612417.068351:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914339968 00000100:00100000:3.0:1788612417.068391:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340096 00000100:00100000:3.0:1788612417.068394:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340096 00000100:00100000:3.0:1788612417.068431:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788612417.068439:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914339968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612417.068482:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914339968:12345-0@lo:400:kworker.0 Request processed in 43us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612417.068488:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788612417.068514:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788612417.068520:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914340096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612417.068555:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914340096:12345-0@lo:400:kworker.0 Request processed in 35us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612417.068560:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788612417.068580:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612417.068607:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914340096:0@lo:400:kworker.0 00000100:00100000:3.0:1788612417.068626:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914339968:0@lo:400:kworker.0 00000100:00100000:2.0:1788612417.073217:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914340224:0@lo:400:kworker.0 00000100:00100000:2.0:1788612417.073289:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612417.073342:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612417.073356:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914340352:0@lo:400:kworker.0 00000100:00100000:3.0:1788612417.073373:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340224 00000100:00100000:3.0:1788612417.073382:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340224 00000100:00100000:2.0:1788612417.073382:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612417.073417:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340352 00000100:00100000:2.0:1788612417.073420:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340352 00000100:00100000:3.0:1788612417.073446:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788612417.073446:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788612417.073455:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914340224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612417.073455:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914340352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612417.073504:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914340352:12345-0@lo:400:kworker.0 Request processed in 50us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612417.073512:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788612417.073513:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914340224:12345-0@lo:400:kworker.0 Request processed in 59us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612417.073518:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788612417.073554:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef7480 x1875495914340352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612417.073568:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914340352:0@lo:400:kworker.0 00000100:00100000:2.0:1788612417.073579:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914340224:0@lo:400:kworker.0 00000100:00080000:3.0:1788612417.073732:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788612417.073738:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788612417.134088:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612417.580941:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914340480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612417.581012:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612417.581130:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340480 00000100:00100000:1.0:1788612417.581137:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340480 00000100:00100000:1.0:1788612417.581195:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612417.581205:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914340480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612417.581243:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612417.581289:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914340480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612417.581311:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788612417.581353:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef4700 x1875495914340480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612417.581369:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914340480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612417.597153:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612417.599137:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893341824 00000100:00100000:0.0:1788612417.599156:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893341824 00000100:00100000:3.0:1788612417.600255:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 170 00000100:00100000:3.0:1788612417.600269:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+9:5596:x1875495893341824:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612417.600344:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612417.600366:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e80030200/0xfc956d548af4179a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd7e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.600400:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e80030200/0xfc956d548af4179a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7e6 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.600412:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e80030200/0xfc956d548af4179a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7e6 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612417.600424:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030200, rc 0) 00000100:00100000:3.0:1788612417.600577:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5596:x1875495893341824:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 310us (3436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612417.600585:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 170 00000100:00100000:1.0:1788612417.609772:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612417.610502:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893341952 00000100:00100000:2.0:1788612417.610514:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893341952 00000100:00100000:2.0:1788612417.610577:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 171 00000100:00100000:2.0:1788612417.610588:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5596:x1875495893341952:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612417.610914:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5596:x1875495893341952:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 327us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612417.610922:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 171 00000100:00100000:1.0:1788612417.619314:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612417.619893:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893342080 00000100:00100000:2.0:1788612417.619903:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893342080 00000100:00100000:2.0:1788612417.619956:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 172 00000100:00100000:2.0:1788612417.619968:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5596:x1875495893342080:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612417.620168:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:5596:x1875495893342080:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 202us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612417.620177:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 172 00000100:00100000:1.0:1788612417.626988:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612417.627105:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893342208 00000100:00100000:2.0:1788612417.627118:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893342208 00000100:00100000:2.0:1788612417.627174:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 173 00000100:00100000:2.0:1788612417.627185:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+10:6120:x1875495893342208:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612417.627441:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+10:6120:x1875495893342208:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 256us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612417.627449:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 173 00000100:00100000:3.0:1788612417.630422:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612417.630518:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893342336 00000100:00100000:0.0:1788612417.630528:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893342336 00000100:00100000:0.0:1788612417.630590:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 174 00000100:00100000:0.0:1788612417.630601:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:6120:x1875495893342336:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612417.630831:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:6120:x1875495893342336:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 231us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612417.630862:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 174 00010000:00010000:3.0:1788612418.171560:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788612418.926110:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788612418.926117:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928d85299000 from 4 10000000:01000000:2.0:1788612418.926122:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612418.926165:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612418.926176:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612418.926188:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612418.926214:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914340608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612418.926283:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612418.926329:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90aaec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612418.926353:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340608 00000100:00100000:2.0:1788612418.926359:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340608 00000100:00100000:2.0:1788612418.926406:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788612418.926420:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914340608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612418.926435:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612418.926447:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e8e00/0xfc956d548af417a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af417a1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612418.926470:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e8e00/0xfc956d548af417a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af417a1 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612418.926481:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e8e00/0xfc956d548af417a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af417a1 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612418.926490:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8e00, rc 0) 00000100:00100000:2.0:1788612418.926527:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914340608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612418.926533:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788612418.926577:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914340608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612418.926591:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af417a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612418.926600:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af417a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612418.926647:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914340736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612418.926672:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612418.926687:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90aaec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612418.927046:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340736 00000100:00100000:0.0:1788612418.927063:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340736 00000100:00100000:0.0:1788612418.927101:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788612418.927108:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914340736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612418.927336:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914340736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612418.927343:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788612418.927373:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914340736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612418.927401:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914340864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612418.927437:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612418.927455:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612418.927465:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340864 00000100:00100000:0.0:1788612418.927468:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340864 00000100:00100000:0.0:1788612418.927482:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788612418.927487:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914340864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612418.927614:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914340864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612418.927620:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788612418.927651:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914340864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612418.927801:0:8580:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8580:1875495914340992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612418.927832:0:8580:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612418.927877:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914340992 00000100:00100000:1.0:1788612418.927881:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914340992 00000100:00100000:1.0:1788612418.927900:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788612418.927906:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+17:8580:x1875495914340992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612418.928042:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+17:8580:x1875495914340992:12345-0@lo:502:llog_process_th.0 Request processed in 136us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612418.928123:0:8580:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612418.928137:0:8580:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8580:1875495914340992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788612418.928164:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612418.928174:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612418.928176:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788612418.928184:0:8580:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff928d85299000 00000020:00000080:0.0:1788612418.928186:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788612418.928261:0:8580:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8580:1875495914341120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612418.928293:0:8580:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612418.928304:0:8580:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612418.932378:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914341120 00000100:00100000:2.0:1788612418.932395:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914341120 00000100:00100000:1.0:1788612418.935348:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788612418.946173:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788612418.946200:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+17:8580:x1875495914341120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612418.946465:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+17:8580:x1875495914341120:12345-0@lo:502:llog_process_th.0 Request processed in 273us (18170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612418.946473:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788612418.947129:0:8580:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8580:1875495914341120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788612418.947168:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612418.947175:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612418.947178:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788612418.947183:0:8580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788612418.948026:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788612418.948058:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612418.948183:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af417a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612418.948195:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af417a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612418.948205:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788612418.948208:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928e9162f000 from 4 10000000:01000000:2.0:1788612418.948211:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612418.948246:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612418.948254:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612418.948263:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612418.948286:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914341248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612418.948338:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612418.948378:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90aae480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612418.949420:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914341248 00000100:00100000:0.0:1788612418.949430:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914341248 00000100:00100000:0.0:1788612418.950183:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788612418.950198:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914341248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612418.950218:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612418.950238:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e910d6000/0xfc956d548af417b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af417af expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612418.950265:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e910d6000/0xfc956d548af417b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af417af expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612418.950289:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e910d6000/0xfc956d548af417b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af417af expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612418.950297:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d6000, rc 0) 00000100:00100000:0.0:1788612418.950368:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914341248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612418.950373:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788612418.950421:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914341248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612418.950438:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af417b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612418.950446:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af417b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612418.950511:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914341376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612418.950546:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612418.964641:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612418.973643:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914341376 00000100:00100000:1.0:1788612418.973659:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914341376 00000100:00100000:1.0:1788612418.973725:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788612418.973734:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914341376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612418.974217:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914341376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 481us (23669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612418.974235:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788612418.974281:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914341376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612418.974336:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914341504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612418.974383:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612418.974406:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e98c45a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612418.974422:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914341504 00000100:00100000:1.0:1788612418.974426:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914341504 00000100:00100000:1.0:1788612418.974442:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788612418.974448:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914341504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612418.974582:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914341504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612418.974588:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788612418.974615:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914341504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612418.977284:0:8587:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8587:1875495914341632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612418.977359:0:8587:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612418.977402:0:8587:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e98c45240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612418.977532:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914341632 00000100:00100000:2.0:1788612418.977541:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914341632 00000100:00100000:2.0:1788612418.977590:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788612418.977598:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+18:8587:x1875495914341632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612418.977870:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+18:8587:x1875495914341632:12345-0@lo:502:llog_process_th.0 Request processed in 272us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612418.977877:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788612418.988428:0:8587:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8587:1875495914341632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788612418.988484:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612418.988498:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612418.988500:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788612418.988508:0:8587:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff928e9162f000 00000020:00000080:1.0:1788612418.988510:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788612418.988957:0:8587:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8587:1875495914341760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612418.990642:0:8587:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612418.990702:0:8587:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e98c45240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612418.992339:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914341760 00000100:00100000:3.0:1788612418.992351:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914341760 00000100:00100000:3.0:1788612418.992408:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788612418.992419:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:8587:x1875495914341760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612418.992672:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:8587:x1875495914341760:12345-0@lo:502:llog_process_th.0 Request processed in 255us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612418.992680:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788612418.993206:0:8587:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8587:1875495914341760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788612418.993250:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612418.993258:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612418.993261:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788612418.993266:0:8587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788612418.994169:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788612418.994190:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788612418.994199:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af417b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612418.994211:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af417b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612418.994222:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788612418.994224:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928e98e67000 from 4 10000000:01000000:3.0:1788612418.994227:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788612418.994261:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612418.994269:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612418.994278:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612418.994301:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914341888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788612418.994349:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612418.994401:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec0357e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612418.996466:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914341888 00000100:00100000:2.0:1788612418.996480:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914341888 00000100:00100000:2.0:1788612418.996531:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788612418.996540:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914341888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612418.996554:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612418.996569:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e8400/0xfc956d548af417c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af417bd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612418.996595:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e8400/0xfc956d548af417c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af417bd expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612418.996605:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e8400/0xfc956d548af417c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af417bd expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612418.996614:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8400, rc 0) 00000100:00100000:2.0:1788612418.996682:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914341888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (2332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612418.996688:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788612418.996825:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914341888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612418.997154:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af417c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612418.997165:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af417c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612418.997229:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914342016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612418.997261:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612418.997299:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec0357e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612418.999638:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914342016 00000100:00100000:0.0:1788612418.999653:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914342016 00000100:00100000:0.0:1788612418.999713:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788612418.999723:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914342016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612419.000044:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914342016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (2781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612419.000063:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788612419.003223:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914342016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612419.003289:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914342144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612419.003370:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612419.003418:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec0357e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612419.003603:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914342144 00000100:00100000:3.0:1788612419.003611:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914342144 00000100:00100000:3.0:1788612419.003665:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788612419.003674:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914342144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612419.003886:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914342144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612419.003893:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788612419.003943:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914342144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612419.007140:0:8590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c51880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8590:1875495914342272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612419.007233:0:8590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612419.007287:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914342272 00000100:00100000:3.0:1788612419.007295:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914342272 00000100:00100000:3.0:1788612419.007341:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788612419.007351:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:8590:x1875495914342272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612419.007559:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:8590:x1875495914342272:12345-0@lo:502:llog_process_th.0 Request processed in 209us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612419.007567:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788612419.007611:0:8590:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec0357e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612419.007631:0:8590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c51880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8590:1875495914342272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612419.007660:0:8590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612419.007671:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612419.007674:0:8590:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788612419.007682:0:8590:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff928e98e67000 00000020:00000080:3.0:1788612419.007684:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788612419.008027:0:8590:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c51880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8590:1875495914342400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612419.008077:0:8590:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612419.008091:0:8590:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec0357e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612419.008460:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914342400 00000100:00100000:2.0:1788612419.008467:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914342400 00000100:00100000:2.0:1788612419.008500:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788612419.008508:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:8590:x1875495914342400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612419.008661:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:8590:x1875495914342400:12345-0@lo:502:llog_process_th.0 Request processed in 154us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612419.008673:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788612419.012413:0:8590:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c51880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:8590:1875495914342400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612419.012452:0:8590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612419.012461:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612419.012463:0:8590:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788612419.012468:0:8590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788612419.012686:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788612419.012707:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612419.012717:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af417c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612419.012727:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af417c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612419.179989:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612420.205637:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612421.051388:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612421.051432:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612421.051540:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893342464 00000100:00100000:3.0:1788612421.051551:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893342464 00000100:00100000:3.0:1788612421.051613:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 190 00000100:00100000:3.0:1788612421.051623:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2355:x1875495893342464:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612421.051705:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2355:x1875495893342464:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 82us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612421.051724:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 190 00000100:00100000:2.0:1788612421.053298:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893342592 00000100:00100000:2.0:1788612421.053310:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893342592 00000100:00100000:2.0:1788612421.053495:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:2.0:1788612421.053506:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893342592:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612421.053574:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893342592:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 71us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612421.053580:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00080000:3.0:1788612421.055798:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612421.064453:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612421.064504:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612421.064649:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893342848 00000100:00100000:1.0:1788612421.064660:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893342848 00000100:00100000:1.0:1788612421.064725:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893342720 00000100:00100000:1.0:1788612421.064729:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893342720 00000100:00100000:1.0:1788612421.064753:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:1.0:1788612421.064761:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2356:x1875495893342848:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612421.064866:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2356:x1875495893342848:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 105us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612421.064874:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:1.0:1788612421.064890:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1788612421.064896:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893342720:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612421.064920:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893342720:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 25us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612421.064926:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00080000:3.0:1788612421.065370:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788612421.065375:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788612421.228045:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612421.679406:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914342528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612421.679489:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612421.679628:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914342528 00000100:00100000:1.0:1788612421.679638:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914342528 00000100:00100000:1.0:1788612421.679713:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788612421.679723:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec074b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914342528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612421.679768:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612421.679831:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec074b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914342528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612421.679858:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788612421.679902:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef7b80 x1875495914342528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612421.679922:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914342528:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788612421.680231:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612422.189201:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914342656:0@lo:400:kworker.0 00000100:00100000:1.0:1788612422.189277:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.189335:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914343168:0@lo:400:kworker.0 00000100:00100000:1.0:1788612422.189361:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.189387:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788612422.189393:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914342784:0@lo:400:kworker.0 00000100:00100000:1.0:1788612422.189413:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.189429:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914343296:0@lo:400:kworker.0 00000100:00100000:1.0:1788612422.189450:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.189478:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914342912:0@lo:400:kworker.0 00000100:00100000:1.0:1788612422.189499:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.189519:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612422.189524:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914343040:0@lo:400:kworker.0 00000100:00100000:1.0:1788612422.189547:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.189594:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914343168 00000100:00100000:1.0:1788612422.189601:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914343168 00000100:00100000:1.0:1788612422.189651:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914342784 00000100:00100000:1.0:1788612422.189655:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914342784 00000100:00100000:1.0:1788612422.189667:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914342912 00000100:00100000:1.0:1788612422.189669:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914342912 00000100:00100000:1.0:1788612422.189701:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788612422.189710:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914343168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612422.189763:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914343168:12345-0@lo:400:kworker.0 Request processed in 55us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.189771:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788612422.189787:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612422.189793:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914342784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612422.189819:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914342784:12345-0@lo:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.189825:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612422.189857:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612422.189864:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914342912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612422.189900:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914342912:12345-0@lo:400:kworker.0 Request processed in 37us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.189905:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612422.189940:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914343296 00000100:00100000:1.0:1788612422.189944:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914343296 00000100:00100000:1.0:1788612422.189971:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914343040 00000100:00100000:1.0:1788612422.189974:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914343040 00000100:00100000:1.0:1788612422.189992:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788612422.189997:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914343296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612422.190042:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914343296:12345-0@lo:400:kworker.0 Request processed in 44us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.190048:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788612422.190059:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612422.190065:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914343040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612422.190103:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914343040:12345-0@lo:400:kworker.0 Request processed in 38us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.190109:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788612422.190131:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612422.190135:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788612422.190168:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928d87ef4700 x1875495914343040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612422.190182:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914343040:0@lo:400:kworker.0 00000100:00100000:1.0:1788612422.190194:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914342912:0@lo:400:kworker.0 00000100:00100000:1.0:1788612422.190223:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914342784:0@lo:400:kworker.0 00010000:00080000:1.0:1788612422.190233:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928d87ef5880 x1875495914343296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612422.190243:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914343296:0@lo:400:kworker.0 00000100:00100000:1.0:1788612422.190251:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914343168:0@lo:400:kworker.0 00000100:00100000:2.0:1788612422.190469:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914342656 00000100:00100000:2.0:1788612422.190475:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914342656 00000100:00100000:2.0:1788612422.190516:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788612422.190524:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914342656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612422.190575:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914342656:12345-0@lo:400:kworker.0 Request processed in 52us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612422.190581:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788612422.193865:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914342656:0@lo:400:kworker.0 00010000:00010000:0.0:1788612422.252686:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612422.700255:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914343424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612422.700326:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612422.700692:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914343424 00000100:00100000:1.0:1788612422.700701:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914343424 00000100:00100000:1.0:1788612422.700756:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788612422.700766:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914343424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612422.700802:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612422.700876:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914343424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612422.700884:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788612422.701203:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98e90a80 x1875495914343424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612422.701223:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914343424:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788612423.276176:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788612423.558488:0:8805:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788612424.300124:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612425.325246:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612426.174784:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612426.174825:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612426.174885:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612426.174913:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612426.174943:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893343104 00000100:00100000:1.0:1788612426.174952:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893343104 00000100:00100000:1.0:1788612426.175030:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:1.0:1788612426.175041:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893343104:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612426.175114:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893343104:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 75us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612426.175122:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:1.0:1788612426.175148:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893343232 00000100:00100000:1.0:1788612426.175153:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893343232 00000100:00100000:1.0:1788612426.175175:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893343360 00000100:00100000:1.0:1788612426.175178:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893343360 00000100:00100000:1.0:1788612426.175198:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:1.0:1788612426.175217:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893343232:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612426.175244:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893343232:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 40us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612426.175250:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:1.0:1788612426.175261:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:1.0:1788612426.175266:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893343360:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612426.175287:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893343360:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 21us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612426.175292:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00080000:1.0:1788612426.175319:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612426.175323:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612426.175326:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612426.176550:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893342976 00000100:00100000:3.0:1788612426.176562:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893342976 00000100:00100000:3.0:1788612426.176680:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 192 00000100:00100000:3.0:1788612426.176689:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2355:x1875495893342976:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612426.176743:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2355:x1875495893342976:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 55us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612426.176750:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 192 00010000:00010000:0.0:1788612426.359229:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612426.797004:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612426.797028:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914343552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612426.797097:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612426.797218:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914343552 00000100:00100000:0.0:1788612426.797239:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914343552 00000100:00100000:0.0:1788612426.797304:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788612426.797313:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914343552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788612426.797356:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788612426.797440:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612426.801832:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914343552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4509us (4724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612426.802645:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788612426.804458:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928d87ef5f80 x1875495914343552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612426.804483:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914343552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612427.310194:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914343680:0@lo:400:kworker.0 00000100:00100000:1.0:1788612427.310268:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612427.310308:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914344192:0@lo:400:kworker.0 00000100:00100000:1.0:1788612427.310332:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612427.310357:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788612427.310362:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914343808:0@lo:400:kworker.0 00000100:00100000:1.0:1788612427.310383:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612427.310398:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914344320:0@lo:400:kworker.0 00000100:00100000:1.0:1788612427.310421:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612427.310448:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914343936:0@lo:400:kworker.0 00000100:00100000:1.0:1788612427.310471:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612427.310488:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612427.310494:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914344064:0@lo:400:kworker.0 00000100:00100000:1.0:1788612427.310513:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612427.310540:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914343680 00000100:00100000:1.0:1788612427.310546:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914343680 00000100:00100000:1.0:1788612427.310599:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788612427.310616:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914343680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612427.310673:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914343680:12345-0@lo:400:kworker.0 Request processed in 59us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612427.310681:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788612427.310705:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914343680:0@lo:400:kworker.0 00000100:00100000:1.0:1788612427.310715:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914344192 00000100:00100000:1.0:1788612427.310718:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914344192 00000100:00080000:2.0:1788612427.310744:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612427.310746:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914343808 00000100:00100000:1.0:1788612427.310749:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914343808 00000100:00100000:1.0:1788612427.310760:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914343936 00000100:00100000:1.0:1788612427.310762:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914343936 00000100:00100000:1.0:1788612427.310787:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612427.310794:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914344192:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788612427.310796:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612427.310833:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914344192:12345-0@lo:400:kworker.0 Request processed in 40us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612427.310857:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612427.310868:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788612427.310869:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914344192:0@lo:400:kworker.0 00000100:00100000:1.0:1788612427.310873:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914343808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612427.310911:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914343808:12345-0@lo:400:kworker.0 Request processed in 38us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612427.310918:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788612427.310929:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788612427.310935:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914343936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612427.310937:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914343808:0@lo:400:kworker.0 00000100:00100000:1.0:1788612427.310967:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914343936:12345-0@lo:400:kworker.0 Request processed in 32us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612427.310984:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788612427.310991:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914343936:0@lo:400:kworker.0 00000100:00100000:1.0:1788612427.311004:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914344320 00000100:00100000:1.0:1788612427.311007:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914344320 00000100:00100000:1.0:1788612427.311045:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914344064 00000100:00100000:1.0:1788612427.311048:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914344064 00000100:00080000:2.0:1788612427.311066:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612427.311066:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788612427.311071:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914344320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612427.311111:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914344320:12345-0@lo:400:kworker.0 Request processed in 39us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612427.311117:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788612427.311128:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788612427.311133:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914344064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612427.311162:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914344064:12345-0@lo:400:kworker.0 Request processed in 29us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612427.311168:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788612427.311203:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928d87ef5180 x1875495914344064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612427.311214:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914344064:0@lo:400:kworker.0 00010000:00080000:2.0:1788612427.311524:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928d87ef5500 x1875495914344320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612427.311535:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914344320:0@lo:400:kworker.0 00010000:00010000:3.0:1788612427.373515:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612427.823752:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612427.823775:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914344448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612427.823854:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612427.823914:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914344448 00000100:00100000:0.0:1788612427.823921:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914344448 00000100:00100000:0.0:1788612427.824085:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788612427.824096:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914344448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612427.824135:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612427.824185:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914344448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612427.824193:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788612427.824279:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98e93b80 x1875495914344448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612427.824298:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914344448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788612428.402515:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788612429.071132:0:9049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing yml_node 00010000:00010000:0.0:1788612429.430686:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612430.444056:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612431.308805:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612431.308895:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612431.308963:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612431.309140:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893343744 00000100:00100000:2.0:1788612431.309152:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893343744 00000100:00100000:2.0:1788612431.309218:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893343872 00000100:00100000:2.0:1788612431.309222:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893343872 00000100:00100000:2.0:1788612431.309249:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:2.0:1788612431.309260:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2352:x1875495893343744:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:2.0:1788612431.309297:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af41700 00000100:00080000:2.0:1788612431.309309:0:6697:0:(import.c:65:import_set_state_nolock()) ffff928e90c67000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788612431.309346:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788612431.310008:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+2:2352:x1875495893343744:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 746us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612431.310032:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:2.0:1788612431.310051:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:2.0:1788612431.310059:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2352:x1875495893343872:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:2.0:1788612431.310076:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af41707 00000100:00080000:2.0:1788612431.310084:0:6697:0:(import.c:65:import_set_state_nolock()) ffff928e90c63000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788612431.310106:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788612431.310306:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+2:2352:x1875495893343872:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 247us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612431.310313:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00080000:1.0:1788612431.310468:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612431.310474:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788612431.311820:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612431.312133:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893343488 00000100:00100000:0.0:1788612431.312158:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893343488 00000100:00100000:0.0:1788612431.312223:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 194 00000100:00100000:0.0:1788612431.312234:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2353:x1875495893343488:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612431.312300:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2353:x1875495893343488:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 69us (3507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612431.312308:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 194 00010000:00010000:0.0:1788612431.312340:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612431.316594:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612431.316678:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893343616 00000100:00100000:2.0:1788612431.316688:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893343616 00000100:00100000:2.0:1788612431.316761:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:2.0:1788612431.316772:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec075ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2353:x1875495893343616:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612431.316886:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec075ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2353:x1875495893343616:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 115us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612431.316893:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00080000:1.0:1788612431.317174:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788612431.468092:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612431.917568:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914344576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612431.917653:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612431.918371:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914344576 00000100:00100000:0.0:1788612431.918382:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914344576 00000100:00100000:0.0:1788612431.918597:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612431.918608:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914344576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788612431.918649:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612431.918786:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914344576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612431.918794:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788612431.919506:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788612431.920044:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e90c53100 x1875495914344576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612431.920071:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914344576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612432.428876:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914344704:0@lo:400:kworker.0 00000100:00100000:1.0:1788612432.428975:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612432.429240:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914344704 00000100:00100000:0.0:1788612432.429248:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914344704 00000100:00100000:0.0:1788612432.429298:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788612432.429308:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914344704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612432.429501:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914344832:0@lo:400:kworker.0 00000100:00100000:3.0:1788612432.429549:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612432.429587:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914344832 00000100:00100000:3.0:1788612432.429592:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914344832 00000100:00100000:3.0:1788612432.429624:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788612432.429631:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914344832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612432.429667:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914344832:12345-0@lo:400:kworker.0 Request processed in 36us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612432.429674:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788612432.429717:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914344832:0@lo:400:kworker.0 00000100:00100000:0.0:1788612432.439210:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914344704:12345-0@lo:400:kworker.0 Request processed in 9769us (10100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612432.439228:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788612432.439719:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914344704:0@lo:400:kworker.0 00000100:00100000:3.0:1788612432.440296:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914344960:0@lo:400:kworker.0 00000100:00100000:3.0:1788612432.440357:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612432.440489:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914344960 00000100:00100000:0.0:1788612432.440496:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914344960 00000100:00100000:0.0:1788612432.440561:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788612432.440571:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914344960:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788612432.441906:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612432.441998:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914345088:0@lo:400:kworker.0 00000100:00100000:1.0:1788612432.442044:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612432.442107:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914345088 00000100:00100000:1.0:1788612432.442113:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914345088 00000100:00100000:1.0:1788612432.442147:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788612432.442154:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914345088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612432.442195:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914345088:12345-0@lo:400:kworker.0 Request processed in 41us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612432.442201:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788612432.442235:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec074b480 x1875495914345088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612432.442247:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914345088:0@lo:400:kworker.0 00000100:00100000:2.0:1788612432.452747:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914345344:0@lo:400:kworker.0 00000100:00100000:2.0:1788612432.452819:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612432.452884:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612432.452891:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914345216:0@lo:400:kworker.0 00000100:00100000:2.0:1788612432.452918:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612432.452970:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914345344 00000100:00100000:2.0:1788612432.452994:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914345344 00000100:00100000:2.0:1788612432.453054:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788612432.453065:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914345344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612432.453320:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914345216 00000100:00100000:1.0:1788612432.453325:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914345216 00000100:00100000:1.0:1788612432.453357:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788612432.453364:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec074b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914345216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612432.453421:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec074b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914345216:12345-0@lo:400:kworker.0 Request processed in 58us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612432.453428:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788612432.453457:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612432.453462:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612432.453688:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914345344:12345-0@lo:400:kworker.0 Request processed in 626us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612432.453694:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788612432.453727:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914345216:0@lo:400:kworker.0 00010000:00080000:2.0:1788612432.453736:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec074a300 x1875495914345344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612432.453747:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914345344:0@lo:400:kworker.0 00000100:00100000:0.0:1788612432.453887:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914344960:12345-0@lo:400:kworker.0 Request processed in 13316us (13528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612432.453903:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788612432.457312:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914344960:0@lo:400:kworker.0 00010000:00010000:0.0:1788612432.492220:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612432.944544:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914345472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612432.944617:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612432.944825:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914345472 00000100:00100000:0.0:1788612432.944859:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914345472 00000100:00100000:0.0:1788612432.944909:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788612432.944917:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914345472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612432.944959:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612432.945010:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914345472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612432.945017:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788612432.945295:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98e93480 x1875495914345472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612432.945315:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914345472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788612433.516023:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788612434.022149:0:9243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00000001:00100000:0.0:1788612434.046166:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000020:00000080:0.0:1788612434.046178:0:6721:0:(genops.c:885:class_export_put()) final put ffff928e90c64000/f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000020:00000080:0.0:1788612434.046217:0:497:0:(genops.c:844:class_export_destroy()) destroying export ffff928e90c64000/f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab for lustre-OST0000 00000020:00000080:0.0:1788612434.046278:0:497:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928e90c67000 for lustre-OST0000 00010000:00010000:0.0:1788612434.540718:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788612435.545300:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000020:00000080:2.0:1788612435.545318:0:7644:0:(genops.c:885:class_export_put()) final put ffff928e90c62800/f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000020:00000080:0.0:1788612435.545692:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff928e90c62800/f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab for lustre-OST0001 00000020:00000080:0.0:1788612435.545756:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928e90c63000 for lustre-OST0001 00010000:00010000:3.0:1788612435.568075:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612436.428119:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612436.428184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612436.428275:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893344000 00000100:00100000:2.0:1788612436.428290:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893344000 00000100:00100000:2.0:1788612436.428377:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 196 00000100:00100000:2.0:1788612436.428390:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2353:x1875495893344000:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612436.428479:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2353:x1875495893344000:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 92us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612436.428487:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 196 00000100:00100000:1.0:1788612436.436438:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893344128 00000100:00100000:1.0:1788612436.436464:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893344128 00000100:00100000:1.0:1788612436.436577:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:1.0:1788612436.436589:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2353:x1875495893344128:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612436.436730:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2353:x1875495893344128:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 142us (8544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612436.436738:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00080000:0.0:1788612436.437110:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788612436.598603:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612437.037190:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914345600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612437.037461:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612437.037833:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914345600 00000100:00100000:3.0:1788612437.037929:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914345600 00000100:00080000:0.0:1788612437.038084:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612437.041115:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788612437.041150:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914345600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612437.041227:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612437.041348:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914345600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 215us (3890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612437.041357:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788612437.043692:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e90c50000 x1875495914345600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612437.043733:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914345600:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788612437.071146:0:9344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00000100:00100000:0.0:1788612437.548786:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914346112:0@lo:400:kworker.0 00000100:00100000:3.0:1788612437.549114:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914345856:0@lo:400:kworker.0 00000100:00100000:2.0:1788612437.549173:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914345728:0@lo:400:kworker.0 00000100:00100000:3.0:1788612437.552583:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612437.555511:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914346368:0@lo:400:kworker.0 00000100:00100000:3.0:1788612437.555599:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612437.555681:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914345984:0@lo:400:kworker.0 00000100:00100000:3.0:1788612437.555713:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612437.555817:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914345856 00000100:00100000:3.0:1788612437.555828:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914345856 00000100:00100000:3.0:1788612437.556187:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914345984 00000100:00100000:3.0:1788612437.556192:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914345984 00000100:00100000:3.0:1788612437.556247:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788612437.556257:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914345856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612437.556334:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914345856:12345-0@lo:400:kworker.0 Request processed in 78us (3763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612437.556341:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788612437.556363:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788612437.556370:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914345984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612437.556404:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914345984:12345-0@lo:400:kworker.0 Request processed in 34us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612437.556410:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788612437.556464:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914345984:0@lo:400:kworker.0 00000100:00100000:3.0:1788612437.556657:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914345856:0@lo:400:kworker.0 00000100:00100000:1.0:1788612437.557402:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914346368 00000100:00100000:1.0:1788612437.557411:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914346368 00000100:00100000:1.0:1788612437.557623:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612437.557635:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914346368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612437.557709:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612437.558233:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612437.558293:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914346240:0@lo:400:kworker.0 00000100:00100000:2.0:1788612437.558330:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612437.558393:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914345728 00000100:00100000:2.0:1788612437.558398:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914345728 00000100:00100000:2.0:1788612437.558437:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788612437.558443:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914345728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612437.558507:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914345728:12345-0@lo:400:kworker.0 Request processed in 63us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612437.558514:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788612437.558553:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914346240 00000100:00100000:2.0:1788612437.558557:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914346240 00000100:00100000:2.0:1788612437.558586:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788612437.558592:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec074a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914346240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612437.558624:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec074a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914346240:12345-0@lo:400:kworker.0 Request processed in 32us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612437.558630:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788612437.558667:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914345728:0@lo:400:kworker.0 00000100:00100000:2.0:1788612437.558682:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914346240:0@lo:400:kworker.0 00000100:00100000:3.0:1788612437.559300:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914346112 00000100:00100000:3.0:1788612437.559310:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914346112 00000100:00100000:3.0:1788612437.559366:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788612437.559375:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914346112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612437.559432:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914346112:12345-0@lo:400:kworker.0 Request processed in 58us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612437.559438:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788612437.559684:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914346368:12345-0@lo:400:kworker.0 Request processed in 2051us (4084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612437.559692:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788612437.560126:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98e90000 x1875495914346368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612437.560146:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914346368:0@lo:400:kworker.0 00000100:00080000:1.0:1788612437.560341:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612437.560350:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788612437.560736:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98e93100 x1875495914346112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612437.560828:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914346112:0@lo:400:kworker.0 00010000:00010000:0.0:1788612437.612500:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612438.063915:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612438.063950:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec075a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914346496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612438.064047:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612438.064788:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914346496 00000100:00100000:1.0:1788612438.064804:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914346496 00000100:00100000:1.0:1788612438.064925:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788612438.064937:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec074bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914346496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612438.064989:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612438.065069:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec074bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914346496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612438.065076:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788612438.065133:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec075a300 x1875495914346496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612438.065156:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec075a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914346496:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788612438.636193:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612439.662435:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788612440.208500:0:9441:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:1.0:1788612440.684203:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612441.531757:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612441.531818:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612441.531963:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893344256 00000100:00100000:2.0:1788612441.531984:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893344256 00000100:00100000:2.0:1788612441.532055:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 198 00000100:00100000:2.0:1788612441.532067:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2356:x1875495893344256:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612441.532155:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2356:x1875495893344256:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 89us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612441.532162:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 198 00000100:00100000:1.0:1788612441.532610:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893344384 00000100:00100000:1.0:1788612441.532616:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893344384 00000100:00100000:1.0:1788612441.532667:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:1.0:1788612441.532677:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893344384:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612441.532720:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893344384:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 46us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612441.532726:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00080000:2.0:1788612441.533597:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788612441.708984:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788612441.845770:0:9490:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 08:47:20 EDT 2026 00000100:00100000:0.0:1788612442.156349:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612442.156373:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914346624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612442.156444:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612442.156569:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914346624 00000100:00100000:2.0:1788612442.156578:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914346624 00000100:00100000:2.0:1788612442.156651:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788612442.156660:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914346624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612442.156698:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612442.156750:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914346624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612442.156757:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788612442.156798:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e90c51180 x1875495914346624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612442.156817:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914346624:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788612442.157027:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612442.668137:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec075b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914347136:0@lo:400:kworker.0 00000100:00100000:1.0:1788612442.668218:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612442.668273:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612442.668279:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914347008:0@lo:400:kworker.0 00000100:00100000:1.0:1788612442.668318:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612442.668348:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914347136 00000100:00100000:1.0:1788612442.668355:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914347136 00000100:00100000:1.0:1788612442.668402:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788612442.668411:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec075bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914347136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612442.668473:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec075bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914347136:12345-0@lo:400:kworker.0 Request processed in 62us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612442.668481:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788612442.668489:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec075a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914346752:0@lo:400:kworker.0 00010000:00080000:1.0:1788612442.668533:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec075b480 x1875495914347136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612442.668558:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec075b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914347136:0@lo:400:kworker.0 00000100:00100000:0.0:1788612442.668763:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec075b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914346880:0@lo:400:kworker.0 00000100:00100000:2.0:1788612442.672264:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612442.672374:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914347264:0@lo:400:kworker.0 00000100:00100000:2.0:1788612442.672416:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612442.672469:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914347008 00000100:00100000:2.0:1788612442.672477:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914347008 00000100:00100000:2.0:1788612442.672533:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914347264 00000100:00100000:2.0:1788612442.672536:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914347264 00000100:00100000:2.0:1788612442.672574:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788612442.672584:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec075a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914347008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612442.672645:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec075a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914347008:12345-0@lo:400:kworker.0 Request processed in 62us (4326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612442.672652:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788612442.672669:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788612442.672692:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec074aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914347264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612442.672738:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec074aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914347264:12345-0@lo:400:kworker.0 Request processed in 36us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612442.672745:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788612442.672780:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612442.672811:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914347264:0@lo:400:kworker.0 00000100:00100000:2.0:1788612442.672996:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914347008:0@lo:400:kworker.0 00000100:00100000:1.0:1788612442.673258:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914346752 00000100:00100000:1.0:1788612442.673263:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914346752 00000100:00100000:1.0:1788612442.673473:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788612442.673483:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914346752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612442.673550:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914346752:12345-0@lo:400:kworker.0 Request processed in 60us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612442.673558:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788612442.677604:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612442.677649:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914347392:0@lo:400:kworker.0 00000100:00100000:0.0:1788612442.678277:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612442.678339:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914346880 00000100:00100000:0.0:1788612442.678348:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914346880 00000100:00100000:0.0:1788612442.678404:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788612442.678415:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914346880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612442.678423:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec075a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914346752:0@lo:400:kworker.0 00000100:00100000:2.0:1788612442.678492:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914347392 00000100:00100000:2.0:1788612442.678497:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914347392 00000100:00100000:2.0:1788612442.678535:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788612442.678560:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914347392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612442.678624:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914347392:12345-0@lo:400:kworker.0 Request processed in 81us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612442.678631:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788612442.678651:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612442.678862:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914346880:12345-0@lo:400:kworker.0 Request processed in 447us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612442.678869:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788612442.678903:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec075b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914346880:0@lo:400:kworker.0 00010000:00080000:0.0:1788612442.678916:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec0759f80 x1875495914347392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612442.678938:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914347392:0@lo:400:kworker.0 00010000:00010000:1.0:1788612442.732272:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612443.179975:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612443.180001:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec075b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914347520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612443.180068:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612443.180259:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914347520 00000100:00100000:1.0:1788612443.180268:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914347520 00000100:00100000:1.0:1788612443.180320:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788612443.180331:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914347520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612443.180368:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612443.180419:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914347520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (349us total) trans 0 rc 0/0 00010000:00080000:2.0:1788612443.180705:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec075b480 x1875495914347520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612443.180724:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec075b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914347520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612443.181281:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788612443.759316:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612444.780592:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612445.805456:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612446.654713:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612446.654810:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893344512 00000100:00100000:2.0:1788612446.654821:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893344512 00000100:00100000:2.0:1788612446.654905:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 200 00000100:00100000:2.0:1788612446.654926:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2353:x1875495893344512:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612446.655002:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2353:x1875495893344512:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 78us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612446.655010:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 200 00000100:00100000:1.0:1788612446.658451:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612446.658570:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893344640 00000100:00100000:2.0:1788612446.658580:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893344640 00000100:00100000:2.0:1788612446.658657:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:2.0:1788612446.658668:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2353:x1875495893344640:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612446.658747:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2353:x1875495893344640:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 82us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612446.658755:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00080000:3.0:1788612446.659020:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788612446.831567:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612447.277369:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914347648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612447.277523:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612447.279774:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914347648 00000100:00100000:0.0:1788612447.279803:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914347648 00000100:00100000:0.0:1788612447.280049:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788612447.280061:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914347648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788612447.280113:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612447.284351:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914347648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4283us (6818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612447.284368:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788612447.284875:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788612447.285018:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e90c52a00 x1875495914347648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612447.285042:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914347648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612447.788198:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914348032:0@lo:400:kworker.0 00000100:00100000:0.0:1788612447.788270:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612447.788345:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914348032 00000100:00100000:0.0:1788612447.788352:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914348032 00000100:00100000:0.0:1788612447.788408:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788612447.788417:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914348032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612447.788469:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914348032:12345-0@lo:400:kworker.0 Request processed in 53us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612447.788475:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788612447.788496:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612447.788530:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914348032:0@lo:400:kworker.0 00000100:00100000:0.0:1788612447.788569:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914348160:0@lo:400:kworker.0 00000100:00100000:0.0:1788612447.788594:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612447.788632:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914348160 00000100:00100000:0.0:1788612447.788636:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914348160 00000100:00100000:0.0:1788612447.788667:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788612447.788673:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914348160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612447.788708:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914348160:12345-0@lo:400:kworker.0 Request processed in 34us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612447.788714:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788612447.788731:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612447.788748:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914348160:0@lo:400:kworker.0 00000100:00100000:1.0:1788612447.788920:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914347776:0@lo:400:kworker.0 00000100:00100000:1.0:1788612447.788953:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612447.788984:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914348288:0@lo:400:kworker.0 00000100:00100000:1.0:1788612447.789009:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612447.789029:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612447.789035:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914347904:0@lo:400:kworker.0 00000100:00100000:1.0:1788612447.789056:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612447.789092:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914348288 00000100:00100000:1.0:1788612447.789097:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914348288 00000100:00100000:1.0:1788612447.789129:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788612447.789136:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914348288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612447.789169:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914348288:12345-0@lo:400:kworker.0 Request processed in 35us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612447.789175:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788612447.789206:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914347904 00000100:00100000:1.0:1788612447.789210:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914347904 00000100:00100000:1.0:1788612447.789230:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788612447.789235:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec075aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914347904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612447.789262:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec075aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914347904:12345-0@lo:400:kworker.0 Request processed in 27us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612447.789267:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788612447.789292:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914347904:0@lo:400:kworker.0 00010000:00080000:1.0:1788612447.789305:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eab92d880 x1875495914348288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612447.789315:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914348288:0@lo:400:kworker.0 00000100:00100000:0.0:1788612447.789635:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914347776 00000100:00100000:0.0:1788612447.789640:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914347776 00000100:00100000:0.0:1788612447.789671:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788612447.789678:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914347776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612447.789723:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914347776:12345-0@lo:400:kworker.0 Request processed in 46us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612447.789729:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1788612447.789757:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612447.789813:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914347776:0@lo:400:kworker.0 00010000:00010000:3.0:1788612447.854277:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612448.300090:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612448.300113:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914348416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612448.300198:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612448.300262:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914348416 00000100:00100000:1.0:1788612448.300270:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914348416 00000100:00100000:1.0:1788612448.300319:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788612448.300328:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914348416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612448.300371:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612448.300700:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914348416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 371us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612448.300708:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788612448.300791:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec0759500 x1875495914348416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612448.300811:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914348416:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788612448.877688:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612449.900030:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612450.924364:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612451.792821:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612451.792914:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612451.793034:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893344768 00000100:00100000:3.0:1788612451.793045:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893344768 00000100:00100000:2.0:1788612451.793113:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893344896 00000100:00100000:2.0:1788612451.793118:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893344896 00000100:00100000:2.0:1788612451.793254:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:2.0:1788612451.793266:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893344896:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612451.793552:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893344896:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 285us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612451.793560:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:0.0:1788612451.794056:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 202 00000100:00100000:0.0:1788612451.794066:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2355:x1875495893344768:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612451.794116:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2355:x1875495893344768:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 52us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612451.794122:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 202 00000100:00080000:3.0:1788612451.797687:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788612451.949028:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612452.401866:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914348544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612452.401958:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612452.402864:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914348544 00000100:00100000:3.0:1788612452.402883:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914348544 00000100:00100000:3.0:1788612452.402947:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788612452.402958:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914348544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612452.402999:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612452.403063:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914348544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612452.403070:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788612452.403090:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788612452.406082:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928d87ef5180 x1875495914348544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612452.406113:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914348544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612452.911562:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914348672:0@lo:400:kworker.0 00000100:00100000:2.0:1788612452.911632:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612452.911678:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914349184:0@lo:400:kworker.0 00000100:00100000:2.0:1788612452.911722:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612452.911760:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612452.911765:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914349056:0@lo:400:kworker.0 00000100:00100000:2.0:1788612452.911787:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612452.911830:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914348800:0@lo:400:kworker.0 00000100:00100000:2.0:1788612452.911882:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612452.911899:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612452.911904:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914348928:0@lo:400:kworker.0 00000100:00100000:2.0:1788612452.911936:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612452.911966:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914348672 00000100:00100000:2.0:1788612452.911974:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914348672 00000100:00100000:2.0:1788612452.912020:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788612452.912029:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3308:x1875495914348672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612452.912188:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3308:x1875495914348672:12345-0@lo:400:kworker.0 Request processed in 159us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612452.912195:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788612452.912232:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914349184 00000100:00100000:2.0:1788612452.912236:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914349184 00000100:00100000:2.0:1788612452.912271:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612452.912277:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914349184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612452.912309:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914349184:12345-0@lo:400:kworker.0 Request processed in 33us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612452.912315:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612452.912333:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914349056 00000100:00100000:2.0:1788612452.912503:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914349056 00000100:00100000:2.0:1788612452.912529:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914348800 00000100:00100000:2.0:1788612452.912532:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914348800 00000100:00100000:2.0:1788612452.912551:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914348928 00000100:00100000:2.0:1788612452.912553:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914348928 00000100:00100000:2.0:1788612452.912564:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788612452.912568:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914349056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612452.912625:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914349056:12345-0@lo:400:kworker.0 Request processed in 56us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612452.912629:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788612452.912640:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788612452.912645:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914348800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612452.912671:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914348800:12345-0@lo:400:kworker.0 Request processed in 26us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612452.912676:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788612452.912686:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788612452.912692:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914348928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612452.912715:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914348928:12345-0@lo:400:kworker.0 Request processed in 25us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612452.912721:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788612452.912764:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612452.912769:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612452.912817:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914348928:0@lo:400:kworker.0 00000100:00100000:2.0:1788612452.912861:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914348800:0@lo:400:kworker.0 00000100:00100000:2.0:1788612452.912893:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914349056:0@lo:400:kworker.0 00000100:00100000:2.0:1788612452.912902:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914348672:0@lo:400:kworker.0 00010000:00080000:2.0:1788612452.912913:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928d87ef5180 x1875495914349184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612452.912934:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914349184:0@lo:400:kworker.0 00010000:00010000:0.0:1788612452.982302:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612453.423865:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612453.429106:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec075b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914349312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612453.429187:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612453.433743:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914349312 00000100:00100000:1.0:1788612453.433758:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914349312 00000100:00100000:1.0:1788612453.433824:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788612453.433915:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914349312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612453.434028:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612453.434169:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914349312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 336us (4982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612453.434176:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788612453.434372:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec075b800 x1875495914349312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612453.434397:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec075b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914349312:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788612453.996087:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612455.021275:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612456.044396:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612456.890922:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612456.890955:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612456.891073:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893345152 00000100:00100000:2.0:1788612456.891082:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893345152 00000100:00100000:2.0:1788612456.891140:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:2.0:1788612456.891147:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2354:x1875495893345152:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612456.891216:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2354:x1875495893345152:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 70us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612456.891227:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:1.0:1788612456.891572:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893345024 00000100:00100000:1.0:1788612456.891576:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893345024 00000100:00100000:1.0:1788612456.891607:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 204 00000100:00100000:1.0:1788612456.891612:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2353:x1875495893345024:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612456.891634:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2353:x1875495893345024:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612456.891638:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 204 00000100:00080000:3.0:1788612456.895524:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788612457.068085:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612457.520737:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadeaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914349440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612457.520811:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612457.521033:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914349440 00000100:00100000:2.0:1788612457.521043:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914349440 00000100:00080000:3.0:1788612457.521129:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612457.521394:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612457.521409:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914349440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788612457.521453:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612457.521661:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914349440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612457.521669:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788612457.522779:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eadeaaa00 x1875495914349440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612457.522806:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadeaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914349440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612458.028776:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec075b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914349952:0@lo:400:kworker.0 00000100:00100000:1.0:1788612458.028871:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612458.028931:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612458.028938:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914349824:0@lo:400:kworker.0 00000100:00100000:1.0:1788612458.028962:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612458.028997:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914349952 00000100:00100000:1.0:1788612458.029005:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914349952 00000100:00100000:1.0:1788612458.029063:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914349824 00000100:00100000:1.0:1788612458.029067:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914349824 00000100:00100000:1.0:1788612458.029094:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788612458.029102:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec075b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914349952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612458.029155:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec075b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914349952:12345-0@lo:400:kworker.0 Request processed in 53us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612458.029161:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788612458.029180:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788612458.029187:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec075a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875495914349824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612458.029215:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec075a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875495914349824:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612458.029221:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788612458.029254:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612458.029288:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914349824:0@lo:400:kworker.0 00000100:00100000:1.0:1788612458.029299:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec075b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914349952:0@lo:400:kworker.0 00000100:00100000:0.0:1788612458.029479:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec075b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914349696:0@lo:400:kworker.0 00000100:00100000:0.0:1788612458.029513:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612458.029531:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788612458.029538:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914349568:0@lo:400:kworker.0 00000100:00100000:0.0:1788612458.029574:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612458.029594:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914350080:0@lo:400:kworker.0 00000100:00100000:0.0:1788612458.029630:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612458.030114:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914349568 00000100:00100000:2.0:1788612458.030120:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914349568 00000100:00100000:2.0:1788612458.030159:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788612458.030166:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3308:x1875495914349568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612458.030212:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3308:x1875495914349568:12345-0@lo:400:kworker.0 Request processed in 47us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612458.030219:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788612458.030257:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914349568:0@lo:400:kworker.0 00000100:00100000:1.0:1788612458.030945:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914350080 00000100:00100000:1.0:1788612458.030952:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914350080 00000100:00100000:1.0:1788612458.031003:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788612458.031012:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914350080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612458.031064:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914350080:12345-0@lo:400:kworker.0 Request processed in 55us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612458.031071:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788612458.031102:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec0759f80 x1875495914350080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612458.031114:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914350080:0@lo:400:kworker.0 00000100:00100000:1.0:1788612458.031144:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914349696 00000100:00100000:1.0:1788612458.031147:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914349696 00000100:00100000:1.0:1788612458.031172:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788612458.031178:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914349696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612458.031213:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914349696:12345-0@lo:400:kworker.0 Request processed in 35us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612458.031219:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788612458.031246:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec075b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914349696:0@lo:400:kworker.0 00000100:00080000:0.0:1788612458.031466:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1788612458.047986:0:10122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:47:36 (1788612456) === 00010000:00010000:0.0:1788612458.093074:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612458.389095:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612458.389208:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893345280 00000100:00100000:0.0:1788612458.389220:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893345280 00000100:00100000:0.0:1788612458.389286:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 206 00000100:00100000:0.0:1788612458.389302:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+10:8123:x1875495893345280:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788612458.389320:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612458.389339:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e910d6e00/0xfc956d548af417cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd7ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612458.389371:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e910d6e00/0xfc956d548af417cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7ed expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612458.389383:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e910d6e00/0xfc956d548af417cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7ed expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612458.389393:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d6e00, rc 0) 00000100:00100000:0.0:1788612458.389461:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+11:8123:x1875495893345280:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 165us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612458.389468:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 206 00000100:00100000:2.0:1788612458.400891:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612458.401099:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893345408 00000100:00100000:0.0:1788612458.401110:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893345408 00000100:00100000:0.0:1788612458.401169:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 207 00000100:00100000:0.0:1788612458.401178:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+11:8123:x1875495893345408:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788612458.402169:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+11:8123:x1875495893345408:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 987us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612458.402181:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 207 00000100:00100000:1.0:1788612458.404994:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612458.405210:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893345536 00000100:00100000:0.0:1788612458.405222:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893345536 00000100:00100000:0.0:1788612458.405289:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 208 00000100:00100000:0.0:1788612458.405299:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+11:8123:x1875495893345536:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788612458.405546:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+11:8123:x1875495893345536:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 247us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612458.405554:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 208 00000100:00100000:2.0:1788612458.408946:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612458.410647:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893345664 00000100:00100000:0.0:1788612458.410662:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893345664 00000100:00100000:0.0:1788612458.410753:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 209 00000100:00100000:0.0:1788612458.410765:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+11:8127:x1875495893345664:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612458.411469:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+11:8127:x1875495893345664:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 703us (2527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612458.411480:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 209 00000100:00100000:3.0:1788612458.436067:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612458.436152:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893345792 00000100:00100000:2.0:1788612458.436162:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893345792 00000100:00100000:2.0:1788612458.436233:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 210 00000100:00100000:2.0:1788612458.436244:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+11:8127:x1875495893345792:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612458.436536:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+11:8127:x1875495893345792:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 293us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612458.436544:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 210 00000100:00100000:1.0:1788612458.444068:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612458.444183:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893345920 00000100:00100000:0.0:1788612458.444196:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893345920 00000100:00100000:0.0:1788612458.444252:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 211 00000100:00100000:0.0:1788612458.444263:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+11:8123:x1875495893345920:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788612458.444281:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612458.444309:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e910d6400/0xfc956d548af417d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd817 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612458.444361:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e910d6400/0xfc956d548af417d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd817 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612458.444374:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e910d6400/0xfc956d548af417d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd817 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612458.444384:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d6400, rc 0) 00000100:00100000:0.0:1788612458.444448:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+12:8123:x1875495893345920:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 187us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612458.444456:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 211 00000100:00100000:3.0:1788612458.447135:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612458.447318:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893346048 00000100:00100000:0.0:1788612458.447328:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893346048 00000100:00100000:0.0:1788612458.447387:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 212 00000100:00100000:0.0:1788612458.447398:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+12:8123:x1875495893346048:12345-192.168.202.6@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788612458.447424:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788612458.447447:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788612458.447452:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788612458.447455:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788612458.447458:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788612458.450119:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+12:8123:x1875495893346048:12345-192.168.202.6@tcp:256:mount.lustre.0 Request processed in 2711us (2983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612458.450135:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 212 00000100:00100000:2.0:1788612458.462357:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612458.462642:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893346176 00000100:00100000:0.0:1788612458.462654:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893346176 00000100:00100000:0.0:1788612458.462720:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 213 00000100:00100000:0.0:1788612458.462732:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+12:8123:x1875495893346176:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788612458.462764:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612458.462785:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e910d6c00/0xfc956d548af417d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd81e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612458.462815:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e910d6c00/0xfc956d548af417d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd81e expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612458.462872:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e910d6c00/0xfc956d548af417d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd81e expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612458.462883:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d6c00, rc 0) 00000100:00100000:0.0:1788612458.462945:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:8123:x1875495893346176:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 215us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612458.462951:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 213 00000100:00100000:2.0:1788612458.471393:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612458.471531:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893346304 00000100:00100000:0.0:1788612458.471540:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893346304 00000100:00100000:0.0:1788612458.471597:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 214 00000100:00100000:0.0:1788612458.471608:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:8123:x1875495893346304:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788612458.471934:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:8123:x1875495893346304:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 327us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612458.471942:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 214 00000100:00100000:3.0:1788612458.473953:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612458.474056:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893346432 00000100:00100000:1.0:1788612458.474064:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893346432 00000100:00100000:1.0:1788612458.474117:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 215 00000100:00100000:1.0:1788612458.474126:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:8123:x1875495893346432:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788612458.474530:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:8123:x1875495893346432:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 403us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612458.474538:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 215 00000100:00100000:1.0:1788612458.479066:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612458.479293:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893346560 00000100:00100000:2.0:1788612458.479305:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893346560 00000100:00100000:2.0:1788612458.479412:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 216 00000100:00100000:2.0:1788612458.479423:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:8130:x1875495893346560:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612458.479690:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:8130:x1875495893346560:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 258us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612458.479698:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 216 00000100:00100000:3.0:1788612458.489742:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612458.499998:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893346688 00000100:00100000:0.0:1788612458.500015:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893346688 00000100:00100000:0.0:1788612458.500067:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 217 00000100:00100000:0.0:1788612458.500077:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:8130:x1875495893346688:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612458.502730:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:8130:x1875495893346688:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 2643us (12987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612458.502759:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 217 00000100:00100000:3.0:1788612458.506175:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612458.506215:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612458.506450:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893347200 00000100:00100000:1.0:1788612458.506460:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893347200 00000100:00100000:1.0:1788612458.506534:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893346816 00000100:00100000:1.0:1788612458.506538:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893346816 00000100:00100000:1.0:1788612458.506559:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:1.0:1788612458.506569:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2354:x1875495893347200:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612458.506644:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2354:x1875495893347200:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 76us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612458.506668:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:1.0:1788612458.506697:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1788612458.506703:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2352:x1875495893346816:12345-192.168.202.6@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788612458.506725:0:8316:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 78d21d21-8748-4720-b30a-c0081165c376@192.168.202.6@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:1.0:1788612458.506760:0:8316:0:(genops.c:1385:class_connect()) connect: client 78d21d21-8748-4720-b30a-c0081165c376, cookie 0xfc956d548af417e0 00000004:00100000:1.0:1788612458.506789:0:8316:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788612458.507135:0:8316:0:(import.c:65:import_set_state_nolock()) ffff928e90c65800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612458.507167:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+6:2352:x1875495893346816:12345-192.168.202.6@tcp:38:mount.lustre.0 Request processed in 462us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612458.507174:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00080000:2.0:1788612458.507678:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612458.516444:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612458.516614:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893346944 00000100:00100000:1.0:1788612458.516624:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893346944 00000100:00100000:1.0:1788612458.516720:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1788612458.516732:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+6:0:x1875495893346944:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788612458.516780:0:8316:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788612458.516914:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+6:0:x1875495893346944:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 184us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612458.516921:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00080000:2.0:1788612458.517202:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612458.519652:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612458.519867:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893347072 00000100:00100000:0.0:1788612458.519878:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893347072 00000100:00100000:0.0:1788612458.519931:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:0.0:1788612458.519941:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec075b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+6:8123:x1875495893347072:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788612458.519972:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788612458.520052:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec075b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+6:8123:x1875495893347072:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 112us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612458.520059:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:0.0:1788612458.522117:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612458.522209:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893347328 00000100:00100000:1.0:1788612458.522217:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893347328 00000100:00100000:1.0:1788612458.522271:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:1.0:1788612458.522281:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+6:8123:x1875495893347328:12345-192.168.202.6@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788612458.522381:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+6:8123:x1875495893347328:12345-192.168.202.6@tcp:40:mount.lustre.0 Request processed in 101us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612458.522402:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:1.0:1788612458.526047:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612458.526088:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612458.526125:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612458.526221:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893347712 00000100:00100000:2.0:1788612458.526231:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893347712 00000100:00100000:2.0:1788612458.526297:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:2.0:1788612458.526307:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78d21d21-8748-4720-b30a-c0081165c376+6:8123:x1875495893347712:12345-192.168.202.6@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788612458.526401:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788612458.526477:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78d21d21-8748-4720-b30a-c0081165c376+6:8123:x1875495893347712:12345-192.168.202.6@tcp:33:mount.lustre.0 Request processed in 171us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612458.526484:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:3.0:1788612458.526612:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893347456 00000100:00100000:3.0:1788612458.526617:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893347456 00000100:00100000:3.0:1788612458.526651:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893347584 00000100:00100000:3.0:1788612458.526654:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893347584 00000100:00100000:3.0:1788612458.526672:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:3.0:1788612458.526678:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec075b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875495893347456:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788612458.526712:0:8463:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 78d21d21-8748-4720-b30a-c0081165c376@192.168.202.6@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:3.0:1788612458.526746:0:8463:0:(genops.c:1385:class_connect()) connect: client 78d21d21-8748-4720-b30a-c0081165c376, cookie 0xfc956d548af417e7 00002000:00100000:3.0:1788612458.526758:0:8463:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 78d21d21-8748-4720-b30a-c0081165c376/ffff928eacf4a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788612458.526768:0:8463:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788612458.527050:0:8463:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788612458.527080:0:8463:0:(import.c:65:import_set_state_nolock()) ffff928eacf4b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612458.527112:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec075b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78d21d21-8748-4720-b30a-c0081165c376+6:2352:x1875495893347456:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 433us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612458.527120:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:3.0:1788612458.527134:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:3.0:1788612458.527139:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875495893347584:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788612458.527154:0:8463:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 78d21d21-8748-4720-b30a-c0081165c376@192.168.202.6@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:3.0:1788612458.527169:0:8463:0:(genops.c:1385:class_connect()) connect: client 78d21d21-8748-4720-b30a-c0081165c376, cookie 0xfc956d548af417ee 00002000:00100000:3.0:1788612458.527174:0:8463:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 78d21d21-8748-4720-b30a-c0081165c376/ffff928eacf4f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788612458.527190:0:8463:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788612458.527785:0:8463:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788612458.527805:0:8463:0:(import.c:65:import_set_state_nolock()) ffff928eacf4e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612458.527873:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78d21d21-8748-4720-b30a-c0081165c376+6:2352:x1875495893347584:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 732us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612458.527881:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:0.0:1788612458.544527:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612458.544550:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914350208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612458.544630:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612458.544704:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914350208 00000100:00100000:3.0:1788612458.544714:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914350208 00000100:00100000:3.0:1788612458.544762:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788612458.544772:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914350208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612458.544793:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1788612458.544916:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec0758e00 x1875495914350208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612458.544935:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914350208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612458.545063:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914350208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612458.545071:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788612459.117859:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788612459.625981:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 78d21d21-8748-4720-b30a-c0081165c376 00010000:00010000:1.0:1788612460.140083:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788612461.163783:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 78d21d21-8748-4720-b30a-c0081165c376 00010000:00010000:1.0:1788612461.164100:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788612461.177403:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 78d21d21-8748-4720-b30a-c0081165c376 00010000:00010000:1.0:1788612462.188109:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612462.636412:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadeaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914350336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612462.636516:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612462.636647:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914350336 00000100:00100000:2.0:1788612462.636655:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914350336 00000100:00100000:2.0:1788612462.636748:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788612462.636759:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914350336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612462.636795:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612462.636862:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914350336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612462.636869:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788612462.637081:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788612462.637199:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eadeaaa00 x1875495914350336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612462.637217:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadeaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914350336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612463.148211:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914350720:0@lo:400:kworker.0 00000100:00100000:3.0:1788612463.148305:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612463.148368:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612463.148375:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914350592:0@lo:400:kworker.0 00000100:00100000:3.0:1788612463.148398:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612463.148431:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914350720 00000100:00100000:3.0:1788612463.148439:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914350720 00000100:00100000:3.0:1788612463.148488:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914350592 00000100:00100000:3.0:1788612463.148491:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914350592 00000100:00100000:3.0:1788612463.148514:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788612463.148523:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea789b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914350720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612463.148572:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea789b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914350720:12345-0@lo:400:kworker.0 Request processed in 50us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612463.148579:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788612463.148596:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788612463.148602:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914350592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612463.148628:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914350592:12345-0@lo:400:kworker.0 Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612463.148634:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788612463.148672:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914350592:0@lo:400:kworker.0 00000100:00100000:3.0:1788612463.148682:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914350720:0@lo:400:kworker.0 00000100:00080000:0.0:1788612463.148826:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612463.148864:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914350848:0@lo:400:kworker.0 00000100:00100000:0.0:1788612463.148894:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612463.148916:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788612463.148921:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914350464:0@lo:400:kworker.0 00000100:00100000:0.0:1788612463.148947:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612463.148983:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914350976:0@lo:400:kworker.0 00000100:00100000:0.0:1788612463.149008:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612463.149033:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914350464 00000100:00100000:0.0:1788612463.149037:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914350464 00000100:00100000:0.0:1788612463.149064:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788612463.149070:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914350464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612463.149103:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914350464:12345-0@lo:400:kworker.0 Request processed in 33us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612463.149109:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788612463.149139:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914350976 00000100:00100000:0.0:1788612463.149143:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914350976 00000100:00100000:0.0:1788612463.149173:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612463.149179:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914350976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612463.149207:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914350976:12345-0@lo:400:kworker.0 Request processed in 29us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612463.149213:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788612463.149228:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612463.149236:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914350848 00000100:00100000:0.0:1788612463.149240:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914350848 00000100:00100000:0.0:1788612463.149263:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788612463.149270:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914350848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612463.149295:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914350848:12345-0@lo:400:kworker.0 Request processed in 27us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612463.149301:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788612463.149313:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612463.149328:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914350464:0@lo:400:kworker.0 00010000:00080000:0.0:1788612463.149340:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec0996300 x1875495914350976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612463.149357:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914350976:0@lo:400:kworker.0 00000100:00100000:0.0:1788612463.149369:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914350848:0@lo:400:kworker.0 00010000:00010000:1.0:1788612463.214803:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612463.550129:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612463.550167:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612463.550194:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612463.550210:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612463.550228:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612463.550253:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893348224 00000100:00100000:3.0:1788612463.550263:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893348224 00000100:00100000:3.0:1788612463.550318:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893348352 00000100:00100000:3.0:1788612463.550322:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893348352 00000100:00100000:0.0:1788612463.550417:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893347968 00000100:00100000:0.0:1788612463.550422:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893347968 00000100:00100000:0.0:1788612463.550450:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893348096 00000100:00100000:0.0:1788612463.550452:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893348096 00000100:00100000:0.0:1788612463.550472:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:0.0:1788612463.550481:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea789b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2353:x1875495893347968:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612463.550545:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea789b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2353:x1875495893347968:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 66us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612463.550553:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:0.0:1788612463.550571:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:0.0:1788612463.550578:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893348096:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612463.550603:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893348096:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612463.550609:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:3.0:1788612463.551053:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:3.0:1788612463.551060:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893348224:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612463.551094:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893348224:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 34us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612463.551099:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:3.0:1788612463.551111:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:3.0:1788612463.551116:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea789bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893348352:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612463.551140:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea789bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893348352:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612463.551145:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:3.0:1788612463.551167:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893347840 00000100:00100000:3.0:1788612463.551171:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893347840 00000100:00100000:3.0:1788612463.551193:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 219 00000100:00100000:3.0:1788612463.551199:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2353:x1875495893347840:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612463.551222:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2353:x1875495893347840:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612463.551227:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 219 00000100:00080000:3.0:1788612463.551462:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788612463.551466:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612463.551469:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612463.663976:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612463.664001:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914351104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612463.664068:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612463.664221:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914351104 00000100:00100000:2.0:1788612463.664229:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914351104 00000100:00100000:2.0:1788612463.664286:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788612463.664297:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914351104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612463.664332:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612463.664425:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914351104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612463.664432:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788612463.665034:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eadea9500 x1875495914351104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612463.665053:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914351104:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788612464.237518:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788612464.356539:0:10317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788612465.260119:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612466.288207:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612467.311012:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612467.756050:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea789a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914351232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612467.756141:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612467.756219:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914351232 00000100:00100000:1.0:1788612467.756227:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914351232 00000100:00100000:1.0:1788612467.756284:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612467.756294:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914351232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612467.756346:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612467.756398:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914351232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612467.756406:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788612467.756428:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788612467.756460:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ea789a680 x1875495914351232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612467.756479:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea789a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914351232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612468.268663:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914351616:0@lo:400:kworker.0 00000100:00100000:2.0:1788612468.268730:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612468.268788:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612468.268795:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914351744:0@lo:400:kworker.0 00000100:00100000:2.0:1788612468.268834:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612468.268920:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914351616 00000100:00100000:2.0:1788612468.268928:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914351616 00000100:00100000:2.0:1788612468.268981:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788612468.268992:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadeaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914351616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612468.269044:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadeaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914351616:12345-0@lo:400:kworker.0 Request processed in 55us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612468.269051:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788612468.269096:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914351616:0@lo:400:kworker.0 00000100:00100000:3.0:1788612468.269241:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914351360:0@lo:400:kworker.0 00000100:00100000:3.0:1788612468.269276:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612468.269305:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadeaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914351872:0@lo:400:kworker.0 00000100:00100000:3.0:1788612468.269324:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612468.269343:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788612468.269348:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadeab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914351488:0@lo:400:kworker.0 00000100:00100000:3.0:1788612468.269365:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612468.269379:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914352000:0@lo:400:kworker.0 00000100:00100000:3.0:1788612468.269398:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612468.269422:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914351744 00000100:00100000:3.0:1788612468.269426:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914351744 00000100:00100000:3.0:1788612468.269452:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914352000 00000100:00100000:3.0:1788612468.269455:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914352000 00000100:00100000:3.0:1788612468.269474:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788612468.269481:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadeab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914351744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612468.269517:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadeab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914351744:12345-0@lo:400:kworker.0 Request processed in 36us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612468.269523:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788612468.269536:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788612468.269542:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea789aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914352000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612468.269574:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea789aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914352000:12345-0@lo:400:kworker.0 Request processed in 32us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612468.269580:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788612468.269596:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914351872 00000100:00100000:3.0:1788612468.269607:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914351872 00000100:00100000:3.0:1788612468.269631:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914351488 00000100:00100000:3.0:1788612468.269634:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914351488 00000100:00100000:3.0:1788612468.269652:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788612468.269657:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914351872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612468.269688:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914351872:12345-0@lo:400:kworker.0 Request processed in 30us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612468.269693:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788612468.269704:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788612468.269710:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914351488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612468.269743:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914351488:12345-0@lo:400:kworker.0 Request processed in 33us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612468.269748:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1788612468.269790:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eadea8700 x1875495914351744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612468.269811:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914351744:0@lo:400:kworker.0 00000100:00100000:3.0:1788612468.269860:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadeab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914351488:0@lo:400:kworker.0 00010000:00080000:3.0:1788612468.269870:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eadea9880 x1875495914352000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612468.269878:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914352000:0@lo:400:kworker.0 00000100:00100000:3.0:1788612468.269886:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadeaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914351872:0@lo:400:kworker.0 00000100:00100000:2.0:1788612468.270133:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914351360 00000100:00100000:2.0:1788612468.270137:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914351360 00000100:00100000:2.0:1788612468.270171:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788612468.270178:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914351360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612468.270213:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914351360:12345-0@lo:400:kworker.0 Request processed in 36us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612468.270231:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788612468.270346:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914351360:0@lo:400:kworker.0 00000100:00080000:1.0:1788612468.273053:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612468.273064:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788612468.334341:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612468.678616:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612468.678726:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893348480 00000100:00100000:0.0:1788612468.678737:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893348480 00000100:00100000:0.0:1788612468.678798:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 221 00000100:00100000:0.0:1788612468.678820:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2356:x1875495893348480:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612468.678933:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2356:x1875495893348480:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 125us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612468.678942:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 221 00000100:00100000:3.0:1788612468.691386:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612468.691556:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612468.691653:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893348608 00000100:00100000:0.0:1788612468.691663:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893348608 00000100:00100000:0.0:1788612468.691748:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:0.0:1788612468.691760:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893348608:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612468.691872:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893348608:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 113us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612468.691880:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00080000:2.0:1788612468.692746:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612468.692824:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893348864 00000100:00100000:1.0:1788612468.692830:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893348864 00000100:00100000:1.0:1788612468.692915:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:1.0:1788612468.692924:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893348864:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612468.692971:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893348864:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 49us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612468.692978:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00080000:2.0:1788612468.693100:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612468.699331:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612468.699382:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612468.699499:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893348736 00000100:00100000:2.0:1788612468.699509:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893348736 00000100:00100000:2.0:1788612468.699592:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:2.0:1788612468.699602:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea789b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+5:2356:x1875495893348736:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612468.699679:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea789b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+5:2356:x1875495893348736:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 78us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612468.699688:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00080000:1.0:1788612468.701204:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612468.704949:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893348992 00000100:00100000:0.0:1788612468.704965:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893348992 00000100:00100000:0.0:1788612468.705152:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:0.0:1788612468.705164:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2356:x1875495893348992:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612468.705259:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2356:x1875495893348992:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 97us (5876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612468.705267:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00080000:1.0:1788612468.709214:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612468.781797:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612468.781875:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914352128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612468.781950:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612468.782085:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914352128 00000100:00100000:2.0:1788612468.782104:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914352128 00000100:00100000:2.0:1788612468.782157:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788612468.782182:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914352128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612468.782218:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612468.782265:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914352128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612468.782272:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788612468.782652:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eadea8380 x1875495914352128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612468.782671:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914352128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788612469.358012:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612470.380205:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612471.405406:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612472.428189:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612472.876443:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612472.876467:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914352256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612472.876535:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612472.876596:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914352256 00000100:00100000:3.0:1788612472.876605:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914352256 00000100:00100000:3.0:1788612472.876718:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788612472.876728:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea789ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914352256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612472.876766:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612472.876812:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea789ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914352256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612472.876819:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788612472.876865:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788612472.876905:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ea7898700 x1875495914352256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612472.876925:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914352256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612473.389818:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914352512:0@lo:400:kworker.0 00000100:00100000:3.0:1788612473.389874:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914352384:0@lo:400:kworker.0 00000100:00100000:0.0:1788612473.389887:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914352768:0@lo:400:kworker.0 00000100:00100000:3.0:1788612473.389948:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612473.389991:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914352896:0@lo:400:kworker.0 00000100:00100000:3.0:1788612473.390017:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612473.390039:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612473.390053:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914352640:0@lo:400:kworker.0 00000100:00100000:3.0:1788612473.390076:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612473.390181:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914352768 00000100:00100000:1.0:1788612473.390189:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914352768 00000100:00100000:1.0:1788612473.390299:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612473.390309:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914352768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612473.390374:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914352768:12345-0@lo:400:kworker.0 Request processed in 66us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612473.390382:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788612473.390425:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eab92d880 x1875495914352768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612473.390440:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914352768:0@lo:400:kworker.0 00000100:00100000:3.0:1788612473.390538:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914352384 00000100:00100000:3.0:1788612473.390543:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914352384 00000100:00100000:3.0:1788612473.390591:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788612473.390598:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914352384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612473.390645:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914352384:12345-0@lo:400:kworker.0 Request processed in 48us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612473.390651:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788612473.390718:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612473.397192:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914353024:0@lo:400:kworker.0 00000100:00100000:1.0:1788612473.397286:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612473.397575:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914352896 00000100:00100000:0.0:1788612473.397586:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914352896 00000100:00100000:0.0:1788612473.397654:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914352640 00000100:00100000:0.0:1788612473.397665:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914352640 00000100:00100000:0.0:1788612473.397684:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914352512 00000100:00100000:0.0:1788612473.397688:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914352512 00000100:00100000:0.0:1788612473.397703:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788612473.397711:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914352896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612473.397768:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914352896:12345-0@lo:400:kworker.0 Request processed in 57us (7749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612473.397775:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788612473.397792:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788612473.397798:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914352640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612473.397832:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914352640:12345-0@lo:400:kworker.0 Request processed in 34us (7755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612473.397861:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788612473.397874:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788612473.397879:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914352512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612473.397926:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914352512:12345-0@lo:400:kworker.0 Request processed in 46us (7208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612473.397931:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788612473.398945:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612473.398985:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914352384:0@lo:400:kworker.0 00000100:00100000:2.0:1788612473.399002:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914352896:0@lo:400:kworker.0 00000100:00100000:2.0:1788612473.400943:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914352640:0@lo:400:kworker.0 00000100:00100000:1.0:1788612473.401605:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914353024 00000100:00100000:1.0:1788612473.401614:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914353024 00000100:00100000:1.0:1788612473.401740:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788612473.401751:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914353024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612473.401831:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914353024:12345-0@lo:400:kworker.0 Request processed in 82us (4544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612473.401859:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788612473.401881:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612473.401918:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914352512:0@lo:400:kworker.0 00010000:00080000:1.0:1788612473.401932:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec0995180 x1875495914353024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612473.401944:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914353024:0@lo:400:kworker.0 00010000:00010000:1.0:1788612473.453217:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612473.794184:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612473.794478:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612473.794976:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612473.795019:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612473.795050:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612473.795142:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893349120 00000100:00100000:1.0:1788612473.795152:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893349120 00000100:00100000:1.0:1788612473.795209:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 223 00000100:00100000:1.0:1788612473.795226:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893349120:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612473.795305:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893349120:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 80us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612473.795312:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 223 00000100:00100000:0.0:1788612473.797190:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893349376 00000100:00100000:0.0:1788612473.797203:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893349376 00000100:00100000:0.0:1788612473.797601:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893349248 00000100:00100000:0.0:1788612473.798082:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893349248 00000100:00100000:0.0:1788612473.798122:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:0.0:1788612473.798145:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893349376:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612473.798435:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893349376:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 93us (3993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612473.798445:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:0.0:1788612473.798466:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:0.0:1788612473.798473:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893349248:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612473.798943:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893349632 00000100:00100000:1.0:1788612473.798951:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893349632 00000100:00100000:0.0:1788612473.798965:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893349248:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 490us (3944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612473.798974:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:1.0:1788612473.798993:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893349504 00000100:00080000:0.0:1788612473.798997:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612473.798998:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893349504 00000100:00080000:0.0:1788612473.799004:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612473.799010:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612473.799376:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:1.0:1788612473.799387:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893349632:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612473.799431:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893349632:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 46us (4455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612473.799438:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:0.0:1788612473.799449:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893349504:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612473.799603:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893349504:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 32us (4428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612473.800294:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:0.0:1788612473.800303:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:0.0:1788612473.900428:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612473.900452:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914353152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612473.900531:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612473.900970:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914353152 00000100:00100000:2.0:1788612473.900980:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914353152 00000100:00100000:2.0:1788612473.901037:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788612473.901048:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914353152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612473.901084:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612473.901226:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914353152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612473.901234:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788612473.909011:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eadea8e00 x1875495914353152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612473.909041:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914353152:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788612474.476690:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612475.500815:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612476.528418:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612477.548122:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612477.996213:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea789a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914353280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612477.996280:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612477.996714:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914353280 00000100:00100000:3.0:1788612477.996723:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914353280 00000100:00100000:3.0:1788612477.996780:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788612477.996789:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914353280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612477.996832:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612477.996899:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914353280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612477.996907:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788612477.999144:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ea789a300 x1875495914353280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612477.999172:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea789a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914353280:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788612478.000037:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612478.508117:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914353792:0@lo:400:kworker.0 00000100:00100000:0.0:1788612478.508178:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612478.508245:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612478.508251:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914353664:0@lo:400:kworker.0 00000100:00100000:0.0:1788612478.508273:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612478.508298:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914353792 00000100:00100000:0.0:1788612478.508305:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914353792 00000100:00100000:0.0:1788612478.508351:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788612478.508361:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914353792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612478.508410:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914353792:12345-0@lo:400:kworker.0 Request processed in 49us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612478.508418:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788612478.508441:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914353664 00000100:00100000:0.0:1788612478.508443:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914353664 00000100:00100000:0.0:1788612478.508467:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788612478.508472:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914353664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612478.508492:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914353664:12345-0@lo:400:kworker.0 Request processed in 21us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612478.508496:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788612478.508525:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914353664:0@lo:400:kworker.0 00010000:00080000:0.0:1788612478.508548:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec01f5880 x1875495914353792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612478.508555:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914353792:0@lo:400:kworker.0 00000100:00100000:2.0:1788612478.508640:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914353408:0@lo:400:kworker.0 00000100:00100000:2.0:1788612478.508667:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612478.508697:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914353920:0@lo:400:kworker.0 00000100:00100000:2.0:1788612478.508720:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612478.508740:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788612478.508746:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914353536:0@lo:400:kworker.0 00000100:00100000:2.0:1788612478.508762:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612478.508781:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914354048:0@lo:400:kworker.0 00000100:00100000:2.0:1788612478.508795:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612478.508812:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914353920 00000100:00100000:2.0:1788612478.508815:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914353920 00000100:00100000:2.0:1788612478.508866:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914353536 00000100:00100000:2.0:1788612478.508870:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914353536 00000100:00100000:2.0:1788612478.508892:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788612478.508897:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadeab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914353920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612478.508922:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadeab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914353920:12345-0@lo:400:kworker.0 Request processed in 26us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612478.508925:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788612478.508934:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788612478.508938:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914353536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612478.508952:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914353536:12345-0@lo:400:kworker.0 Request processed in 14us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612478.508955:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788612478.508995:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914353536:0@lo:400:kworker.0 00000100:00100000:2.0:1788612478.509006:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914353920:0@lo:400:kworker.0 00000100:00100000:0.0:1788612478.509065:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914353408 00000100:00100000:0.0:1788612478.509068:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914353408 00000100:00100000:0.0:1788612478.509096:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788612478.509101:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914353408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612478.509124:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914353408:12345-0@lo:400:kworker.0 Request processed in 24us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612478.509128:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:1.0:1788612478.509195:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612478.509208:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914354048 00000100:00100000:1.0:1788612478.509212:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914354048 00000100:00100000:1.0:1788612478.509249:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612478.509256:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914354048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612478.509285:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914354048:12345-0@lo:400:kworker.0 Request processed in 31us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612478.509289:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788612478.509342:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788612478.509401:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec01f7100 x1875495914354048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612478.509411:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914354048:0@lo:400:kworker.0 00000100:00100000:2.0:1788612478.509420:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914353408:0@lo:400:kworker.0 00010000:00010000:2.0:1788612478.572977:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612478.916196:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612478.916233:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612478.916257:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612478.916280:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612478.916319:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612478.916348:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893350016 00000100:00100000:0.0:1788612478.916358:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893350016 00000100:00100000:0.0:1788612478.916415:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893349888 00000100:00100000:0.0:1788612478.916419:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893349888 00000100:00100000:0.0:1788612478.916444:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:0.0:1788612478.916455:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2356:x1875495893350016:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612478.916534:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2356:x1875495893350016:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 81us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612478.916543:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:0.0:1788612478.916560:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:0.0:1788612478.916575:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893349888:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612478.916601:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893349888:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 28us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612478.916606:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:0.0:1788612478.916628:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893350144 00000100:00100000:0.0:1788612478.916631:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893350144 00000100:00100000:0.0:1788612478.916656:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893350272 00000100:00100000:0.0:1788612478.916659:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893350272 00000100:00100000:0.0:1788612478.916694:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:0.0:1788612478.916701:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2352:x1875495893350144:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:0.0:1788612478.916719:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af417e7 00000100:00080000:0.0:1788612478.916729:0:6695:0:(import.c:65:import_set_state_nolock()) ffff928eacf4b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788612478.916769:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788612478.917104:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78d21d21-8748-4720-b30a-c0081165c376+2:2352:x1875495893350144:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 403us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612478.917111:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:0.0:1788612478.917123:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:0.0:1788612478.917128:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2352:x1875495893350272:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:0.0:1788612478.917140:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af417ee 00000100:00080000:0.0:1788612478.917145:0:6695:0:(import.c:65:import_set_state_nolock()) ffff928eacf4e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788612478.917181:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788612478.917359:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78d21d21-8748-4720-b30a-c0081165c376+2:2352:x1875495893350272:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 229us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612478.917365:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00080000:0.0:1788612478.917386:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788612478.917390:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788612478.917398:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788612478.917532:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612478.917538:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612478.918465:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893349760 00000100:00100000:3.0:1788612478.918475:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893349760 00000100:00100000:3.0:1788612478.918522:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 225 00000100:00100000:3.0:1788612478.918531:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2356:x1875495893349760:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612478.918592:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2356:x1875495893349760:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 61us (2410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612478.918599:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 225 00000100:00100000:3.0:1788612479.021667:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914354176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612479.021756:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612479.021982:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914354176 00000100:00100000:2.0:1788612479.022001:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914354176 00000100:00100000:2.0:1788612479.022067:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788612479.022076:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea789a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914354176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612479.022113:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612479.022160:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea789a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914354176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612479.022167:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788612479.022255:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eadea8e00 x1875495914354176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612479.022275:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914354176:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788612479.596032:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788612480.081787:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 78d21d21-8748-4720-b30a-c0081165c376 00000020:00000080:1.0:1788612480.081796:0:6721:0:(genops.c:885:class_export_put()) final put ffff928eacf4a800/78d21d21-8748-4720-b30a-c0081165c376 00000020:00000080:0.0:1788612480.081938:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff928eacf4a800/78d21d21-8748-4720-b30a-c0081165c376 for lustre-OST0000 00000020:00000080:0.0:1788612480.081985:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928eacf4b800 for lustre-OST0000 00010000:00010000:2.0:1788612480.627161:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788612481.620281:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 78d21d21-8748-4720-b30a-c0081165c376 00000020:00000080:0.0:1788612481.620291:0:7644:0:(genops.c:885:class_export_put()) final put ffff928eacf4f800/78d21d21-8748-4720-b30a-c0081165c376 00000020:00000080:3.0:1788612481.620432:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff928eacf4f800/78d21d21-8748-4720-b30a-c0081165c376 for lustre-OST0001 00000020:00000080:3.0:1788612481.620489:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928eacf4e800 for lustre-OST0001 00010000:00010000:2.0:1788612481.644021:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788612482.254820:0:11021:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788612482.671953:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612483.116496:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea789a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914354304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612483.116562:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612483.116690:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914354304 00000100:00100000:2.0:1788612483.116698:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914354304 00000100:00100000:2.0:1788612483.116758:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788612483.116767:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914354304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612483.116800:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612483.116865:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914354304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612483.116872:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788612483.116907:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ea789a680 x1875495914354304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612483.116925:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea789a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914354304:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788612483.117033:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612483.629189:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914354560:0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.629263:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612483.629315:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914355072:0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.629341:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612483.629374:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788612483.629387:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914354432:0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.629414:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612483.629434:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadeab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914354944:0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.629455:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612483.629481:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadeaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914354688:0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.629500:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612483.629517:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612483.629521:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914354816:0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.629544:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612483.629575:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914354560 00000100:00100000:2.0:1788612483.629582:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914354560 00000100:00100000:2.0:1788612483.629620:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914354944 00000100:00100000:2.0:1788612483.629624:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914354944 00000100:00100000:2.0:1788612483.629644:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914354688 00000100:00100000:2.0:1788612483.629647:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914354688 00000100:00100000:2.0:1788612483.629662:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788612483.629670:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914354560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.629724:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914354560:12345-0@lo:400:kworker.0 Request processed in 54us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612483.629732:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788612483.629748:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788612483.629754:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914354944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.629780:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914354944:12345-0@lo:400:kworker.0 Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612483.629785:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788612483.629795:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788612483.629800:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914354688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.629869:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914354688:12345-0@lo:400:kworker.0 Request processed in 68us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612483.629876:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788612483.630085:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914355072 00000100:00100000:2.0:1788612483.630089:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914355072 00000100:00100000:2.0:1788612483.630123:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914354816 00000100:00100000:2.0:1788612483.630126:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914354816 00000100:00100000:2.0:1788612483.630147:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788612483.630153:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914355072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.630185:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914355072:12345-0@lo:400:kworker.0 Request processed in 32us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612483.630191:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788612483.630203:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788612483.630209:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914354816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.630234:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914354816:12345-0@lo:400:kworker.0 Request processed in 26us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612483.630240:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788612483.630406:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914354432 00000100:00100000:2.0:1788612483.630410:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914354432 00000100:00100000:2.0:1788612483.630438:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788612483.630444:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3306:x1875495914354432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.630475:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3306:x1875495914354432:12345-0@lo:400:kworker.0 Request processed in 31us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612483.630480:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:2.0:1788612483.630514:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612483.630519:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788612483.630555:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eadea9880 x1875495914354816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612483.630577:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914354816:0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.630590:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadeaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914354688:0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.630616:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914354432:0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.630625:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadeab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914354944:0@lo:400:kworker.0 00000100:00100000:2.0:1788612483.630633:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914354560:0@lo:400:kworker.0 00010000:00080000:2.0:1788612483.630642:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eadea8700 x1875495914355072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612483.630651:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914355072:0@lo:400:kworker.0 00010000:00010000:2.0:1788612483.693082:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612484.030264:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612484.030298:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612484.030338:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612484.030367:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893350656 00000100:00100000:0.0:1788612484.030379:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893350656 00000100:00100000:0.0:1788612484.030437:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893350528 00000100:00100000:0.0:1788612484.030441:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893350528 00000100:00100000:0.0:1788612484.030467:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:0.0:1788612484.030477:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893350656:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612484.030553:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893350656:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 77us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612484.030561:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:0.0:1788612484.030579:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:0.0:1788612484.030586:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2353:x1875495893350528:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612484.030609:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2353:x1875495893350528:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612484.030634:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00080000:0.0:1788612484.030653:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612484.031003:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893350400 00000100:00100000:2.0:1788612484.031008:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893350400 00000100:00100000:2.0:1788612484.031048:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 227 00000100:00100000:2.0:1788612484.031056:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2353:x1875495893350400:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612484.031101:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2353:x1875495893350400:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 46us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612484.031107:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 227 00000100:00100000:3.0:1788612484.140045:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612484.140071:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914355200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612484.140154:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612484.141018:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914355200 00000100:00100000:3.0:1788612484.141031:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914355200 00000100:00100000:3.0:1788612484.141096:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788612484.141107:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea789bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914355200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612484.141144:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612484.143654:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea789bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914355200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2539us (3490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612484.143670:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788612484.143757:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ea7898000 x1875495914355200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612484.143781:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914355200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788612484.721813:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788612485.541395:0:11169:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8d93f6e0 20000000:00000080:1.0:1788612485.541413:0:11169:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff928ec07c8c00 uarg=0000000000000000 20000000:01000000:1.0:1788612485.541448:0:11169:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788612485.541454:0:11169:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788612485.541459:0:11169:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788612485.542097:0:11170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788612485.542297:0:11169:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788612485.549271:0:11169:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788612485.549304:0:11169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.549325:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e80030200/0xfc956d548af4179a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7e6 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.549335:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ec21e8e00/0xfc956d548af417a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af417a1 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.549342:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e910d6000/0xfc956d548af417b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af417af expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.549348:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ec21e8400/0xfc956d548af417c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af417bd expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.549354:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e910d6c00/0xfc956d548af417d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd81e expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.549361:0:11169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.549404:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e910d6c00/0xfc956d548af417d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd81e expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.549420:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928e910d6c00/0xfc956d548af417d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd81e expref: 12 pid: 5846 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612485.549448:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875495914355328:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612485.549561:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ec21e8400/0xfc956d548af417c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af417bd expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.549569:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928ec21e8400/0xfc956d548af417c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af417bd expref: 18 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612485.549579:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875495914355456:0@lo:104: 00000100:00100000:1.0:1788612485.549616:0:11169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612485.549660:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e910d6000/0xfc956d548af417b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af417af expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.549668:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e910d6000/0xfc956d548af417b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af417af expref: 18 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612485.549676:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875495914355584:0@lo:104: 00000100:00100000:1.0:1788612485.549697:0:11169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612485.549735:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ec21e8e00/0xfc956d548af417a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af417a1 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.549743:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928ec21e8e00/0xfc956d548af417a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af417a1 expref: 18 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612485.549750:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875495914355712:0@lo:104: 00000100:00100000:1.0:1788612485.549771:0:11169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612485.549792:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e80030200/0xfc956d548af4179a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7e6 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.549810:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928e80030200/0xfc956d548af4179a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7e6 expref: 12 pid: 5846 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612485.549819:0:11169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e93800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875495914355840:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612485.549876:0:11169:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d87f5ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612485.549949:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914355456 00000100:00100000:2.0:1788612485.549956:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914355456 00000100:00100000:2.0:1788612485.549994:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914355584 00000100:00100000:2.0:1788612485.549996:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914355584 00000100:00100000:2.0:1788612485.550006:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914355712 00000100:00100000:2.0:1788612485.550008:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914355712 00000100:00100000:2.0:1788612485.550020:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788612485.550036:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+5:11169:x1875495914355456:12345-0@lo:104: 00010000:00010000:2.0:1788612485.550047:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af417c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550114:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612485.550120:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+5:11169:x1875495914355456:12345-0@lo:104: Request processed in 86us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612485.550127:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788612485.550145:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788612485.550150:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+4:11169:x1875495914355584:12345-0@lo:104: 00010000:00010000:2.0:1788612485.550169:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af417b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550201:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788612485.550206:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+4:11169:x1875495914355584:12345-0@lo:104: Request processed in 56us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612485.550211:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788612485.550222:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612485.550228:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+3:11169:x1875495914355712:12345-0@lo:104: 00010000:00010000:2.0:1788612485.550235:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af417a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550258:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788612485.550263:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+3:11169:x1875495914355712:12345-0@lo:104: Request processed in 36us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612485.550268:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788612485.550469:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788612485.550481:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af417c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550488:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030600 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612485.550492:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af417c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550500:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af417c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612485.550507:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af417c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612485.550513:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788612485.550544:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af417c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550551:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612485.550571:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af417c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550579:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e80030600/0xfc956d548af417bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af417c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550592:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788612485.550595:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af417b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550601:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612485.550604:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af417b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550621:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af417b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612485.550628:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af417b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612485.550633:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788612485.550646:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af417b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550652:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612485.550667:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af417b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550674:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af417af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af417b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550683:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612485.550686:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af417a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550691:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9e00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612485.550694:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af417a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550700:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af417a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612485.550706:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af417a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612485.550717:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788612485.550731:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af417a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550737:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612485.550743:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af417a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550749:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af417a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af417a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.550765:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612485.550767:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612485.550769:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612485.550787:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914355968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612485.550820:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612485.550876:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914356096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612485.550897:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612485.550912:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612485.550917:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914356224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612485.550935:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612485.550958:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914355968 00000100:00100000:2.0:1788612485.550962:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914355968 00010000:00010000:2.0:1788612485.550982:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ec21e8400/0xfc956d548af417c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af417bd expref: 19 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612485.550995:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914356096 00000100:00100000:2.0:1788612485.550997:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914356096 00010000:00010000:2.0:1788612485.551015:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e910d6000/0xfc956d548af417b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af417af expref: 20 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612485.551026:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914356224 00000100:00100000:2.0:1788612485.551028:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914356224 00010000:00010000:2.0:1788612485.551038:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ec21e8e00/0xfc956d548af417a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af417a1 expref: 21 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612485.551048:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788612485.551054:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9238ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+21:3308:x1875495914355968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612485.551063:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612485.551068:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ec21e8400/0xfc956d548af417c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af417bd expref: 21 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.551078:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ec21e8400/0xfc956d548af417c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af417bd expref: 21 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.551092:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612485.551136:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9238ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+21:3308:x1875495914355968:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612485.551144:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788612485.551177:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788612485.551183:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+20:3305:x1875495914356096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612485.551190:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612485.551193:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e910d6000/0xfc956d548af417b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af417af expref: 20 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.551201:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e910d6000/0xfc956d548af417b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af417af expref: 20 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.551221:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612485.551247:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+20:3305:x1875495914356096:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612485.551253:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788612485.551266:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788612485.551272:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914356224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612485.551279:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612485.551283:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ec21e8e00/0xfc956d548af417a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af417a1 expref: 19 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.551290:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ec21e8e00/0xfc956d548af417a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af417a1 expref: 19 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.551300:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612485.551318:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914356224:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612485.551324:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788612485.551356:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914355968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612485.551380:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914356224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612485.551387:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914356096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612485.551468:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612485.551492:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e8400/0xfc956d548af417c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af417bd expref: 18 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612485.551502:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875495914355456:0@lo:104: 00010000:00010000:1.0:1788612485.551512:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e910d6000/0xfc956d548af417b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af417af expref: 17 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612485.551519:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875495914355584:0@lo:104: 00010000:00010000:1.0:1788612485.551526:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e8e00/0xfc956d548af417a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af417a1 expref: 16 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612485.551533:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875495914355712:0@lo:104: 00000100:00100000:2.0:1788612485.558172:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612485.558261:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612485.558335:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893350784 00000100:00100000:0.0:1788612485.558345:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893350784 00010000:00010000:0.0:1788612485.558385:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e910d6c00/0xfc956d548af417d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd81e expref: 13 pid: 5846 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612485.558424:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893350912 00000100:00100000:0.0:1788612485.558427:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893350912 00010000:00010000:0.0:1788612485.558451:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e80030200/0xfc956d548af4179a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7e6 expref: 14 pid: 5846 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612485.558469:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:0.0:1788612485.558478:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93581484-5c48-42e2-a9bb-7e5e07222f81+14:2355:x1875495893350784:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612485.558492:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612485.558498:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e910d6c00/0xfc956d548af417d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd81e expref: 14 pid: 5846 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612485.558511:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e910d6c00/0xfc956d548af417d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd81e expref: 14 pid: 5846 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612485.558544:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612485.558598:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93581484-5c48-42e2-a9bb-7e5e07222f81+14:2355:x1875495893350784:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 120us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612485.558606:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:0.0:1788612485.558626:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:0.0:1788612485.558632:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893350912:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612485.558655:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612485.558660:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e80030200/0xfc956d548af4179a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7e6 expref: 13 pid: 5846 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612485.558668:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e80030200/0xfc956d548af4179a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7e6 expref: 13 pid: 5846 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612485.558680:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612485.558688:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612485.558708:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612485.558715:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612485.558722:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612485.558729:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612485.558735:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61c00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612485.558739:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612485.558748:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612485.558770:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612485.558780:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612485.558800:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893350912:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 167us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612485.558807:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 29 00010000:00010000:1.0:1788612485.559993:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e910d6c00/0xfc956d548af417d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd81e expref: 12 pid: 5846 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612485.560009:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875495914355328:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612485.560022:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e80030200/0xfc956d548af4179a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7e6 expref: 11 pid: 5846 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612485.560031:0:11169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e93800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1875495914355840:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612485.560075:0:11169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.560085:0:11169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.560091:0:11169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612485.560098:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b61c00/0xfc956d548af417f5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612485.740032:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612486.666331:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612486.666422:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893351040 00000100:00100000:2.0:1788612486.666434:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893351040 00000100:00100000:2.0:1788612486.666513:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 228 00000100:00100000:2.0:1788612486.666522:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+11:5596:x1875495893351040:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612486.666539:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612486.666560:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e9800/0xfc956d548af417fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd848 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612486.666589:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e9800/0xfc956d548af417fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd848 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612486.666601:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e9800/0xfc956d548af417fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd848 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612486.666610:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9800, rc 0) 00000100:00100000:2.0:1788612486.666663:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+12:5596:x1875495893351040:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 142us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612486.666669:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 228 00000100:00100000:0.0:1788612486.676270:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612486.676424:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893351168 00000100:00100000:1.0:1788612486.676436:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893351168 00000100:00100000:1.0:1788612486.676502:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 229 00000100:00100000:1.0:1788612486.676513:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+12:5596:x1875495893351168:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612486.676829:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+12:5596:x1875495893351168:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 316us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612486.676874:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 229 00000100:00100000:3.0:1788612486.686289:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612486.687073:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893351296 00000100:00100000:0.0:1788612486.687086:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893351296 00000100:00100000:0.0:1788612486.687156:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 230 00000100:00100000:0.0:1788612486.687166:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+12:5596:x1875495893351296:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612486.687424:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+12:5596:x1875495893351296:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 257us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612486.687432:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 230 00000100:00100000:2.0:1788612486.692292:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612486.692388:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893351424 00000100:00100000:3.0:1788612486.692402:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893351424 00000100:00100000:3.0:1788612486.692477:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 231 00000100:00100000:3.0:1788612486.692490:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+12:5596:x1875495893351424:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612486.692508:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612486.692526:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e80030000/0xfc956d548af41803 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd84f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612486.692577:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e80030000/0xfc956d548af41803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd84f expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612486.692601:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e80030000/0xfc956d548af41803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd84f expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612486.692610:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030000, rc 0) 00000100:00100000:3.0:1788612486.692670:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:5596:x1875495893351424:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 183us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612486.692677:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 231 00000100:00100000:2.0:1788612486.696919:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612486.696957:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893351552 00000100:00100000:2.0:1788612486.696966:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893351552 00000100:00100000:2.0:1788612486.697028:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 232 00000100:00100000:2.0:1788612486.697040:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:5596:x1875495893351552:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612486.697363:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:5596:x1875495893351552:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 324us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612486.697370:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 232 00000100:00100000:0.0:1788612486.705188:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612486.708718:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893351680 00000100:00100000:3.0:1788612486.708746:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893351680 00000100:00100000:3.0:1788612486.708811:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 233 00000100:00100000:3.0:1788612486.708824:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:5596:x1875495893351680:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612486.709093:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:5596:x1875495893351680:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 272us (3914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612486.709101:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 233 00010000:00010000:1.0:1788612486.764832:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788612487.467950:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788612487.467960:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928d85299000 from 7 10000000:01000000:2.0:1788612487.467966:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612487.468019:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612487.468042:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612487.468055:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612487.468084:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914356352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612487.468172:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612487.468358:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacc40cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612487.468475:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914356352 00000100:00100000:3.0:1788612487.468483:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914356352 00000100:00100000:3.0:1788612487.468547:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788612487.468558:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914356352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612487.468572:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612487.468585:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e80030400/0xfc956d548af41811 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af4180a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612487.468610:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e80030400/0xfc956d548af41811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af4180a expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612487.468629:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e80030400/0xfc956d548af41811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4180a expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612487.468638:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030400, rc 0) 00000100:00100000:3.0:1788612487.468680:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914356352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612487.468687:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788612487.468830:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914356352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612487.468868:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41811 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612487.468878:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41811 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612487.468932:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914356480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612487.468958:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612487.468975:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacc40cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612487.469033:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914356480 00000100:00100000:3.0:1788612487.469038:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914356480 00000100:00100000:3.0:1788612487.469067:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788612487.469074:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914356480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612487.469502:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914356480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 427us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612487.469598:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914356480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612487.469628:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914356608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612487.469667:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612487.469683:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacc40cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612487.469697:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914356608 00000100:00100000:2.0:1788612487.469708:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914356608 00000100:00100000:3.0:1788612487.469737:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788612487.472430:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788612487.472450:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914356608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612487.479086:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914356608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6636us (9410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612487.479101:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788612487.480863:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914356608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788612487.483214:0:11239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788612487.483503:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788612487.483538:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612487.483549:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41811 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612487.483560:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41811 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612487.483570:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788612487.483573:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928e9162f000 from 7 10000000:01000000:0.0:1788612487.483583:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612487.483620:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612487.483628:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612487.483638:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612487.483663:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914356736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612487.483727:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612487.483769:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612487.484281:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914356736 00000100:00100000:3.0:1788612487.484289:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914356736 00000100:00100000:3.0:1788612487.484427:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788612487.484437:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914356736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612487.484452:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612487.484466:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e80030200/0xfc956d548af4181f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41818 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612487.484491:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e80030200/0xfc956d548af4181f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41818 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612487.484502:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e80030200/0xfc956d548af4181f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41818 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612487.484673:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030200, rc 0) 00000100:00100000:3.0:1788612487.484729:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914356736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 292us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612487.484736:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788612487.484823:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914356736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612487.484867:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4181f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612487.484878:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4181f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612487.484935:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914356864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612487.484963:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612487.484988:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a263c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612487.485062:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914356864 00000100:00100000:2.0:1788612487.485068:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914356864 00000100:00100000:2.0:1788612487.485097:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788612487.485104:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914356864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612487.485361:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914356864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612487.485369:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788612487.485543:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914356864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612487.485573:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914356992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612487.485615:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612487.485637:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612487.485749:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914356992 00000100:00100000:3.0:1788612487.485754:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914356992 00000100:00100000:3.0:1788612487.485790:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788612487.485796:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914356992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612487.485954:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914356992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612487.485961:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788612487.485998:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914356992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788612487.486920:0:11241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788612487.487178:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788612487.487206:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612487.487216:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4181f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612487.487227:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4181f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612487.487247:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788612487.487250:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928e98e67000 from 7 10000000:01000000:0.0:1788612487.487252:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612487.487282:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612487.487290:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612487.487299:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612487.487318:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914357120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612487.487360:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612487.487396:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a26a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612487.487494:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914357120 00000100:00100000:2.0:1788612487.487501:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914357120 00000100:00100000:2.0:1788612487.487551:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788612487.487559:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914357120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612487.487569:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612487.487582:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e8600/0xfc956d548af4182d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41826 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612487.487604:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e8600/0xfc956d548af4182d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41826 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612487.487614:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e8600/0xfc956d548af4182d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41826 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612487.487623:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8600, rc 0) 00000100:00100000:2.0:1788612487.487665:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914357120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612487.487672:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788612487.487709:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914357120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612487.487722:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4182d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612487.487731:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4182d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612487.487776:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914357248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612487.487801:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612487.487814:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacc40480 going to sleep for 11 seconds 00000100:00100000:2.0:1788612487.487825:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914357248 00000100:00100000:2.0:1788612487.487829:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914357248 00000100:00100000:2.0:1788612487.487874:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788612487.487881:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914357248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612487.488263:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914357248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 380us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612487.488271:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788612487.488302:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914357248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612487.488328:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914357376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612487.488364:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612487.488376:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacc40480 going to sleep for 11 seconds 00000100:00100000:2.0:1788612487.488387:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914357376 00000100:00100000:2.0:1788612487.488391:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914357376 00000100:00100000:2.0:1788612487.488418:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788612487.488424:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914357376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612487.488668:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914357376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612487.488676:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788612487.488711:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914357376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788612487.489719:0:11242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788612487.493681:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788612487.493719:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788612487.493732:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4182d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612487.493746:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4182d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612487.788788:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612488.239375:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914357504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612488.239450:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612488.239545:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914357504 00000100:00100000:3.0:1788612488.239554:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914357504 00000100:00100000:3.0:1788612488.239617:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788612488.239628:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914357504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612488.240696:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788612488.241210:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612488.254013:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914357504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 14377us (14553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612488.254029:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788612488.255238:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ea7898000 x1875495914357504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612488.255275:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914357504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612488.748303:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875495914358016:0@lo:400:kworker.0 00000100:00100000:0.0:1788612488.748374:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612488.748436:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788612488.748443:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914357632:0@lo:400:kworker.0 00000100:00100000:0.0:1788612488.748472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612488.748492:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914358144:0@lo:400:kworker.0 00000100:00100000:0.0:1788612488.748517:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612488.748559:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358016 00000100:00100000:0.0:1788612488.748567:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358016 00000100:00100000:0.0:1788612488.748627:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788612488.748636:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875495914358016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612488.748691:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875495914358016:12345-0@lo:400:kworker.0 Request processed in 57us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612488.748698:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788612488.748739:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875495914358016:0@lo:400:kworker.0 00000100:00100000:2.0:1788612488.748888:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914357760:0@lo:400:kworker.0 00000100:00100000:2.0:1788612488.748917:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612488.748942:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612488.748947:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914357888:0@lo:400:kworker.0 00000100:00100000:2.0:1788612488.748967:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612488.748996:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914357632 00000100:00100000:2.0:1788612488.749000:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914357632 00000100:00100000:2.0:1788612488.749028:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788612488.749035:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3307:x1875495914357632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612488.749068:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3307:x1875495914357632:12345-0@lo:400:kworker.0 Request processed in 33us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612488.749074:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788612488.749244:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358144 00000100:00100000:2.0:1788612488.749248:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358144 00000100:00100000:2.0:1788612488.749289:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788612488.749296:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914358144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612488.749329:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914358144:12345-0@lo:400:kworker.0 Request processed in 33us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612488.749342:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788612488.749360:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612488.749364:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612488.749373:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914357760 00000100:00100000:2.0:1788612488.749376:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914357760 00000100:00100000:2.0:1788612488.749396:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914357888 00000100:00100000:2.0:1788612488.749399:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914357888 00000100:00100000:2.0:1788612488.749421:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788612488.749426:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914357760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612488.749459:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914357760:12345-0@lo:400:kworker.0 Request processed in 33us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612488.749465:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788612488.749477:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788612488.749483:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914357888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612488.749508:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914357888:12345-0@lo:400:kworker.0 Request processed in 26us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612488.749513:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1788612488.749533:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612488.749553:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914357888:0@lo:400:kworker.0 00000100:00100000:2.0:1788612488.749563:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914357760:0@lo:400:kworker.0 00000100:00100000:2.0:1788612488.749589:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914357632:0@lo:400:kworker.0 00010000:00080000:2.0:1788612488.749601:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec01f4380 x1875495914358144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612488.749611:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914358144:0@lo:400:kworker.0 00010000:00010000:1.0:1788612488.820533:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612489.150630:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612489.150672:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612489.150858:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612489.151020:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893351808 00000100:00100000:1.0:1788612489.151030:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893351808 00000100:00100000:1.0:1788612489.151081:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 244 00000100:00100000:1.0:1788612489.151092:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2354:x1875495893351808:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612489.151161:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2354:x1875495893351808:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 71us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612489.151199:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 244 00000100:00100000:1.0:1788612489.151238:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893352064 00000100:00100000:1.0:1788612489.151242:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893352064 00000100:00100000:1.0:1788612489.151275:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893351936 00000100:00100000:1.0:1788612489.151278:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893351936 00000100:00100000:1.0:1788612489.151299:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:1.0:1788612489.151306:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2354:x1875495893352064:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612489.151338:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2354:x1875495893352064:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 33us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612489.151345:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:1.0:1788612489.151357:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:1.0:1788612489.151364:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2354:x1875495893351936:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612489.151389:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2354:x1875495893351936:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 25us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612489.151395:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00080000:1.0:1788612489.153536:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612489.268308:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914358272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612489.268381:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612489.272645:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358272 00000100:00100000:0.0:1788612489.272661:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358272 00000100:00100000:0.0:1788612489.273995:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788612489.274010:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea789aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914358272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612489.274054:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612489.276860:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea789aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914358272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2824us (8447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612489.276874:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788612489.277607:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98e91180 x1875495914358272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612489.277628:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914358272:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788612489.835968:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788612490.018173:0:11367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788612490.860058:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612491.890021:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612492.918977:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612493.358724:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914358400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612493.358796:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612493.358888:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358400 00000100:00100000:3.0:1788612493.358895:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358400 00000100:00100000:3.0:1788612493.358957:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788612493.358966:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914358400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612493.359001:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612493.359048:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914358400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612493.359055:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788612493.359078:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788612493.359113:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ea7899c00 x1875495914358400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612493.359132:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914358400:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788612493.681721:0:11467:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:48:12 (1788612492) === 00000100:00100000:2.0:1788612493.878620:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914358784:0@lo:400:kworker.0 00000100:00100000:2.0:1788612493.878691:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612493.878768:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358784 00000100:00100000:2.0:1788612493.878775:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358784 00000100:00100000:2.0:1788612493.878855:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788612493.878868:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914358784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612493.878929:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914358784:12345-0@lo:400:kworker.0 Request processed in 63us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612493.878937:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1788612493.878962:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612493.879003:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914358784:0@lo:400:kworker.0 00000100:00100000:2.0:1788612493.879045:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914358912:0@lo:400:kworker.0 00000100:00100000:2.0:1788612493.879070:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612493.879098:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358912 00000100:00100000:2.0:1788612493.879102:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358912 00000100:00100000:2.0:1788612493.879131:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788612493.879137:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914358912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612493.879169:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914358912:12345-0@lo:400:kworker.0 Request processed in 32us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612493.879176:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788612493.879191:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612493.879205:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914358912:0@lo:400:kworker.0 00000100:00100000:3.0:1788612493.879296:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914358528:0@lo:400:kworker.0 00000100:00100000:3.0:1788612493.879334:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612493.879378:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914359040:0@lo:400:kworker.0 00000100:00100000:3.0:1788612493.879407:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612493.879425:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612493.879431:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914358656:0@lo:400:kworker.0 00000100:00100000:3.0:1788612493.879451:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612493.879547:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358528 00000100:00100000:2.0:1788612493.879552:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358528 00000100:00100000:2.0:1788612493.879626:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788612493.879634:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3307:x1875495914358528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612493.879706:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3307:x1875495914358528:12345-0@lo:400:kworker.0 Request processed in 73us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612493.879713:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788612493.886422:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914358528:0@lo:400:kworker.0 00000100:00100000:2.0:1788612493.886690:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914359040 00000100:00100000:2.0:1788612493.886699:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914359040 00000100:00100000:2.0:1788612493.886779:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788612493.886788:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914359040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612493.886905:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914359040:12345-0@lo:400:kworker.0 Request processed in 118us (7496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612493.886913:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788612493.886942:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914358656 00000100:00100000:2.0:1788612493.886945:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914358656 00000100:00100000:2.0:1788612493.886974:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788612493.886980:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea789a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914358656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612493.887016:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea789a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914358656:12345-0@lo:400:kworker.0 Request processed in 36us (7564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612493.887022:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788612493.887054:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914358656:0@lo:400:kworker.0 00010000:00080000:2.0:1788612493.887069:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec0302a00 x1875495914359040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612493.887079:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914359040:0@lo:400:kworker.0 00000100:00080000:3.0:1788612493.887223:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788612493.932134:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612493.933696:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612493.933749:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612493.933878:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893352192 00000100:00100000:2.0:1788612493.933890:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893352192 00000100:00100000:2.0:1788612493.933985:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:2.0:1788612493.933996:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893352192:12345-192.168.202.6@tcp:41:mkdir.0 00000004:00000024:2.0:1788612493.934048:0:8316:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788612493.934137:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893352192:12345-192.168.202.6@tcp:41:mkdir.0 Request processed in 143us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612493.934145:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:0.0:1788612493.934238:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893352320 00000100:00100000:0.0:1788612493.934243:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893352320 00000100:00100000:0.0:1788612493.934289:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:0.0:1788612493.934297:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:9674:x1875495893352320:12345-192.168.202.6@tcp:700:mkdir.0 00000100:00100000:0.0:1788612493.934331:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:9674:x1875495893352320:12345-192.168.202.6@tcp:700:mkdir.0 Request processed in 35us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612493.934339:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00080000:3.0:1788612493.934768:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612493.938685:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612493.938788:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893352576 00000100:00100000:2.0:1788612493.938799:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893352576 00000100:00100000:2.0:1788612493.938901:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:2.0:1788612493.938912:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:9674:x1875495893352576:12345-192.168.202.6@tcp:36:mkdir.0 00010000:00010000:2.0:1788612493.938978:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612493.939060:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41715 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7d1 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.939084:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e91fbb900) 00010000:00010000:2.0:1788612493.939109:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612493.939458:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41834 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.939477:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41834 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.939489:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41834 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.939518:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4183b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.939526:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4183b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.939542:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4183b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612493.940887:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788612493.940906:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41834 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.940918:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41834 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.940927:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41834 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.940933:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612493.940940:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41834 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.940950:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41834 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.940966:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:2.0:1788612493.940969:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612493.940975:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41834 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.940982:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41834 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612493.941005:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000626ff6be reply state 00000000b7022b3d transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4183b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612493.941025:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788612493.941132:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:9674:x1875495893352576:12345-192.168.202.6@tcp:36:mkdir.0 Request processed in 2217us (2451us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788612493.941149:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00010000:00010000:3.0:1788612493.943624:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4183b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612493.943647:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4183b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612493.943658:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4183b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612493.943664:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612493.943669:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4183b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612493.943679:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4183b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612493.943706:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff928e9231da00) 00010000:00010000:3.0:1788612493.943709:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612493.943717:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4183b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612493.943747:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4183b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612493.964996:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612493.965217:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893352704 00000100:00100000:2.0:1788612493.965228:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893352704 00000100:00100000:2.0:1788612493.965344:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:2.0:1788612493.965355:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:9675:x1875495893352704:12345-192.168.202.6@tcp:101:chmod.0 00010000:00010000:2.0:1788612493.965387:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612493.965417:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41842 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd856 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.965499:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41849 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.965514:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.965526:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612493.965565:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788612493.965568:0:8316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612493.965610:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.965640:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41842 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd856 expref: 8 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.965685:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41849 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd856 expref: 7 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.965694:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:2.0:1788612493.965697:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612493.965701:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9e00, rc 0) 00000100:00100000:2.0:1788612493.965768:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:9675:x1875495893352704:12345-192.168.202.6@tcp:101:chmod.0 Request processed in 414us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612493.965775:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:1.0:1788612493.979898:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612493.980193:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893352960 00000100:00100000:2.0:1788612493.980203:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893352960 00000100:00100000:2.0:1788612493.980272:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:2.0:1788612493.980283:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:9675:x1875495893352960:12345-192.168.202.6@tcp:36:chmod.0 00010000:00010000:2.0:1788612493.980339:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612493.980365:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41849 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd856 expref: 7 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.980383:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:2.0:1788612493.980397:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612493.980420:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41850 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.980433:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41850 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612493.980442:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41850 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612493.980765:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000198a61a reply state 000000004403f897 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41850 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612493.980774:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788612493.980782:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788612493.981091:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:9675:x1875495893352960:12345-192.168.202.6@tcp:36:chmod.0 Request processed in 808us (1259us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788612493.981100:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00010000:00010000:0.0:1788612493.983314:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41850 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612493.983332:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41850 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612493.983353:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41850 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612493.983359:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612493.983364:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41850 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612493.983373:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41850 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612493.983389:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d200) 00010000:00010000:0.0:1788612493.983392:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788612493.983397:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41850 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612493.983403:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41850 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612494.028510:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612494.028636:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893353088 00000100:00100000:2.0:1788612494.028647:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893353088 00000100:00100000:2.0:1788612494.028716:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:2.0:1788612494.028726:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:9676:x1875495893353088:12345-192.168.202.6@tcp:101:chown.0 00010000:00010000:2.0:1788612494.028749:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612494.028771:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41857 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd85d expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.028894:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9200/0xfc956d548af4185e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.028909:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9200/0xfc956d548af4185e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.028920:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9200/0xfc956d548af4185e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612494.028954:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788612494.028957:0:8316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612494.028993:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9200/0xfc956d548af4185e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.029038:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41857 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd85d expref: 9 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.029057:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9200/0xfc956d548af4185e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd85d expref: 8 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.029065:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:2.0:1788612494.029068:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612494.029072:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9200, rc 0) 00000100:00100000:2.0:1788612494.029129:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:9676:x1875495893353088:12345-192.168.202.6@tcp:101:chown.0 Request processed in 404us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612494.029136:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:3.0:1788612494.032113:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612494.032213:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893353216 00000100:00100000:0.0:1788612494.032223:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893353216 00000100:00100000:0.0:1788612494.032291:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:0.0:1788612494.032302:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:9676:x1875495893353216:12345-192.168.202.6@tcp:101:chown.0 00010000:00010000:0.0:1788612494.032322:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612494.032342:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af41865 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd864 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032408:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4186c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032422:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4186c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032448:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4186c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032464:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41873 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032472:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032478:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032570:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af4187a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032578:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af4187a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032585:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af4187a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612494.032629:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788612494.032633:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612494.032654:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af4187a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032666:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4186c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032673:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4186c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032691:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4186c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032697:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612494.032702:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4186c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032710:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4186c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032722:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:0.0:1788612494.032725:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612494.032729:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4186c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032737:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4186c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032750:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032756:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41873 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032762:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41873 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032768:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d6000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612494.032770:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41873 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032787:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41873 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032795:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff928e91fbbf00) 00010000:00010000:0.0:1788612494.032797:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612494.032800:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41873 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032806:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41873 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032889:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af41865 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd864 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032904:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af4187a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd864 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.032911:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff928e91fbbb00) 00010000:00010000:0.0:1788612494.032913:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612494.032916:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d7600, rc 0) 00000100:00100000:0.0:1788612494.032970:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:9676:x1875495893353216:12345-192.168.202.6@tcp:101:chown.0 Request processed in 670us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612494.032978:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:0.0:1788612494.040506:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612494.040830:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893353472 00000100:00100000:2.0:1788612494.040882:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893353472 00000100:00100000:2.0:1788612494.040984:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:2.0:1788612494.041005:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:9676:x1875495893353472:12345-192.168.202.6@tcp:36:chown.0 00010000:00010000:2.0:1788612494.041059:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612494.041086:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af4187a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd864 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.041102:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff928e91fbbb00) 00010000:00010000:2.0:1788612494.041112:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612494.041139:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41881 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.041152:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.041180:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612494.096050:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788612494.101410:0:8316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000823cb7ee reply state 00000000a743a56b transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612494.101429:0:8316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788612494.101459:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788612494.101556:0:8316:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788612494.101573:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:9676:x1875495893353472:12345-192.168.202.6@tcp:36:chown.0 Request processed in 60577us (61073us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788612494.101582:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00010000:00010000:1.0:1788612494.102242:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612494.102264:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41881 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612494.102272:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41881 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612494.102278:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612494.102283:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41881 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612494.102291:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41881 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612494.102310:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff928e9231de00) 00010000:00010000:1.0:1788612494.102314:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788612494.102319:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41881 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612494.102326:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41881 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612494.127063:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612494.127395:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893353600 00000100:00100000:2.0:1788612494.127406:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893353600 00000100:00100000:2.0:1788612494.127472:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:2.0:1788612494.127483:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:9677:x1875495893353600:12345-192.168.202.6@tcp:101:touch.500 00010000:00010000:2.0:1788612494.127507:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612494.127527:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8800/0xfc956d548af41888 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd86b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788612494.129175:0:5853:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1599us 00010000:00010000:0.0:1788612494.153916:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af4188f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.153942:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af4188f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.153955:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af4188f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.153971:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41896 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.153978:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.153984:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154338:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4189d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154350:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4189d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154357:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4189d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612494.154386:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788612494.154389:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612494.154425:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4189d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154436:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af4188f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154442:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af4188f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154449:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af4188f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154454:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d6c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612494.154458:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af4188f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154466:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af4188f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154478:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:0.0:1788612494.154481:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612494.154485:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af4188f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154490:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af4188f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154503:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154517:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41896 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154522:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41896 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154526:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d6000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612494.154529:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41896 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154534:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41896 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154542:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff928e91fbbf00) 00010000:00010000:0.0:1788612494.154544:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612494.154547:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41896 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154553:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41896 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154603:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8800/0xfc956d548af41888 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd86b expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154622:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4189d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd86b expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.154629:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff928e91fbb700) 00010000:00010000:0.0:1788612494.154631:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788612494.154641:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d7e00, rc 0) 00000100:00100000:0.0:1788612494.155500:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:9677:x1875495893353600:12345-192.168.202.6@tcp:101:touch.500 Request processed in 28013us (28440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612494.155513:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:1.0:1788612494.160440:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612494.160505:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893353856 00000100:00100000:3.0:1788612494.160515:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893353856 00000100:00100000:3.0:1788612494.160608:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:3.0:1788612494.160619:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:9677:x1875495893353856:12345-192.168.202.6@tcp:101:touch.500 00010000:00010000:3.0:1788612494.160640:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612494.160659:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076e00/0xfc956d548af418a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd872 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.163143:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.163167:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.163183:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.163198:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af418b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.163205:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af418b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.163212:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af418b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788612494.164515:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788612494.165319:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af418b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.165339:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af418b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.165351:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af418b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.165404:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.165412:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.165419:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.165425:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612494.165430:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.165438:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.165450:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff928e91fbb700) 00010000:00010000:3.0:1788612494.165454:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612494.165458:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.165666:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612494.165684:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003db47af0 reply state 00000000a66625a8 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af418b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612494.165692:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788612494.165785:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076e00/0xfc956d548af418a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd872 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.166049:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af418b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd872 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.166060:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff928ea7bbcd00) 00010000:00010000:3.0:1788612494.166063:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612494.166066:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0076000, rc 0) 00000100:00100000:3.0:1788612494.166179:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+10:9677:x1875495893353856:12345-192.168.202.6@tcp:101:touch.500 Request processed in 5561us (5749us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788612494.166188:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00010000:00010000:0.0:1788612494.169454:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af418b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.169472:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af418b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.169480:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af418b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.169485:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612494.169490:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af418b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.169497:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af418b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.169517:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff928ea7bbc100) 00010000:00010000:0.0:1788612494.169521:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612494.169525:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af418b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.169531:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af418b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612494.177039:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612494.177293:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893354112 00000100:00100000:0.0:1788612494.177304:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893354112 00000100:00100000:0.0:1788612494.177366:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:0.0:1788612494.177377:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:9677:x1875495893354112:12345-192.168.202.6@tcp:36:touch.500 00010000:00010000:0.0:1788612494.177445:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612494.177471:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af418b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd872 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.177489:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff928ea7bbcd00) 00010000:00010000:0.0:1788612494.177500:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612494.177539:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af418c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.177553:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af418c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.177564:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af418c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788612494.177693:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3445389 reply state 0000000085ad65f3 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af418c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612494.177703:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612494.179351:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+10:9677:x1875495893354112:12345-192.168.202.6@tcp:36:touch.500 Request processed in 1966us (2312us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788612494.179363:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00010000:00010000:1.0:1788612494.187311:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af418c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612494.187344:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af418c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612494.187351:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af418c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612494.187357:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d6000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612494.187362:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af418c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612494.187370:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af418c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612494.187387:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff928e91fbbf00) 00010000:00010000:1.0:1788612494.187390:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612494.187396:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af418c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612494.187402:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af418c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612494.187793:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612494.187902:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893354240 00000100:00100000:0.0:1788612494.187914:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893354240 00000100:00100000:0.0:1788612494.187973:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:0.0:1788612494.187984:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:9677:x1875495893354240:12345-192.168.202.6@tcp:101:touch.500 00010000:00010000:0.0:1788612494.188014:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612494.188036:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af418ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd879 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.188114:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af418ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd879 expref: 10 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.188128:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af418ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd879 expref: 10 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.188147:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff928e91fbba00) 00010000:00010000:0.0:1788612494.188149:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788612494.188152:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d6c00, rc 0) 00000100:00100000:0.0:1788612494.188213:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+10:9677:x1875495893354240:12345-192.168.202.6@tcp:101:touch.500 Request processed in 231us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612494.188220:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:2.0:1788612494.194674:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612494.194827:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893354368 00000100:00100000:0.0:1788612494.194880:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893354368 00000100:00100000:0.0:1788612494.194921:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:0.0:1788612494.194930:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875495893354368:12345-192.168.202.6@tcp:8:touch.500 00010000:00080000:0.0:1788612494.194966:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:0.0:1788612494.194997:0:6695:0:(genops.c:1385:class_connect()) connect: client f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab, cookie 0xfc956d548af418d5 00002000:00100000:0.0:1788612494.195009:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab/ffff928d8507d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788612494.195035:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788612494.195265:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788612494.195294:0:6695:0:(import.c:65:import_set_state_nolock()) ffff928d8507a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612494.195362:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2352:x1875495893354368:12345-192.168.202.6@tcp:8:touch.500 Request processed in 431us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612494.195389:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:2.0:1788612494.199374:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612494.199519:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893354496 00000100:00100000:0.0:1788612494.199529:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893354496 00000100:00080000:3.0:1788612494.199669:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612494.199709:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:0.0:1788612494.199720:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:0:x1875495893354496:12345-192.168.202.6@tcp:2:touch.500 00000001:00080000:2.0:1788612494.261467:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1788612494.261485:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000100:00100000:0.0:1788612494.262097:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:0:x1875495893354496:12345-192.168.202.6@tcp:2:touch.500 Request processed in 62373us (62728us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788612494.262109:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1788612494.265013:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612494.265365:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893354752 00000100:00100000:0.0:1788612494.265376:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893354752 00000100:00100000:0.0:1788612494.265441:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:0.0:1788612494.265452:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+10:9677:x1875495893354752:12345-192.168.202.6@tcp:35:touch.500 00000100:00100000:0.0:1788612494.265971:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:9677:x1875495893354752:12345-192.168.202.6@tcp:35:touch.500 Request processed in 520us (968us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788612494.265980:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:2.0:1788612494.271953:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612494.273103:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893354880 00000100:00100000:1.0:1788612494.273116:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893354880 00000100:00100000:1.0:1788612494.273187:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 246 00000100:00100000:1.0:1788612494.273196:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893354880:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612494.273294:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893354880:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 99us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612494.273320:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 246 00000100:00100000:1.0:1788612494.281814:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612494.282704:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893355008 00000100:00100000:2.0:1788612494.282716:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893355008 00000100:00100000:2.0:1788612494.282807:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:2.0:1788612494.282819:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893355008:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:3.0:1788612494.282943:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612494.283156:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893355008:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 338us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612494.283163:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:2.0:1788612494.292233:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612494.292325:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893355136 00000100:00100000:3.0:1788612494.292336:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893355136 00000100:00100000:3.0:1788612494.292397:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:3.0:1788612494.292408:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:9678:x1875495893355136:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:3.0:1788612494.292432:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612494.292453:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076e00/0xfc956d548af418dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd880 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.292533:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.292548:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.292560:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612494.292592:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788612494.292596:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612494.292644:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.292671:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076e00/0xfc956d548af418dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd880 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.292696:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd880 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.292705:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff928e91fbb700) 00010000:00010000:3.0:1788612494.292708:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612494.292712:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077200, rc 0) 00000100:00100000:3.0:1788612494.292781:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:9678:x1875495893355136:12345-192.168.202.6@tcp:101:rm.0 Request processed in 375us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612494.292788:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:3.0:1788612494.300712:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612494.300879:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893355392 00000100:00100000:0.0:1788612494.300890:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893355392 00000100:00100000:0.0:1788612494.300954:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:0.0:1788612494.300969:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:9678:x1875495893355392:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:0.0:1788612494.300991:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612494.301016:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7a00/0xfc956d548af418ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd887 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612494.301118:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788612494.301224:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7a00/0xfc956d548af418ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd887 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.301248:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:0.0:1788612494.301262:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612494.301268:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7a00/0xfc956d548af418ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd887 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.301283:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d7a00, rc 0) 00000100:00100000:0.0:1788612494.301342:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:9678:x1875495893355392:12345-192.168.202.6@tcp:101:rm.0 Request processed in 376us (640us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788612494.301349:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:1.0:1788612494.309034:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612494.309118:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893355520 00000100:00100000:0.0:1788612494.309129:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893355520 00000100:00100000:0.0:1788612494.309188:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:0.0:1788612494.309198:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:9678:x1875495893355520:12345-192.168.202.6@tcp:37:rm.0 00000100:00100000:0.0:1788612494.319011:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:9678:x1875495893355520:12345-192.168.202.6@tcp:37:rm.0 Request processed in 9799us (9973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612494.319027:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:1.0:1788612494.322496:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612494.322574:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893355776 00000100:00100000:2.0:1788612494.322583:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893355776 00000100:00100000:2.0:1788612494.322664:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:2.0:1788612494.322674:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e8347d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:9678:x1875495893355776:12345-192.168.202.6@tcp:35:rm.0 00000100:00100000:2.0:1788612494.323204:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e8347d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:9678:x1875495893355776:12345-192.168.202.6@tcp:35:rm.0 Request processed in 528us (713us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788612494.323212:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:1.0:1788612494.326663:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612494.326892:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893356032 00000100:00100000:3.0:1788612494.326966:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893356032 00000100:00100000:3.0:1788612494.327023:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:3.0:1788612494.327034:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:9678:x1875495893356032:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:3.0:1788612494.327059:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612494.327081:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076e00/0xfc956d548af418f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd88e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.327184:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077000/0xfc956d548af418ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.327199:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077000/0xfc956d548af418ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.327212:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077000/0xfc956d548af418ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612494.327223:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788612494.327392:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076e00/0xfc956d548af418f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd88e expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.327413:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077000/0xfc956d548af418ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd88e expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.327423:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff928e91fbb700) 00010000:00010000:3.0:1788612494.327425:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788612494.327429:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077000, rc 0) 00000100:00100000:3.0:1788612494.327493:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:9678:x1875495893356032:12345-192.168.202.6@tcp:101:rm.0 Request processed in 461us (840us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788612494.327500:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:3.0:1788612494.330972:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612494.331117:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893356160 00000100:00100000:0.0:1788612494.331128:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893356160 00000100:00100000:0.0:1788612494.331189:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:0.0:1788612494.331200:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:9678:x1875495893356160:12345-192.168.202.6@tcp:41:rm.0 00000004:00000024:0.0:1788612494.331273:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788612494.331349:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:9678:x1875495893356160:12345-192.168.202.6@tcp:41:rm.0 Request processed in 150us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612494.331357:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:1.0:1788612494.338729:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612494.341758:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893356288 00000100:00100000:3.0:1788612494.341775:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893356288 00000100:00100000:2.0:1788612494.342208:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:2.0:1788612494.342221:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:9678:x1875495893356288:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:2.0:1788612494.342243:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612494.342275:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af4190d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd895 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342340:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41914 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342355:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41914 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342368:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41914 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342382:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4191b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342389:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4191b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342396:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4191b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342492:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41922 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342514:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342521:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612494.342550:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788612494.342554:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612494.342573:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342584:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342604:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41914 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342618:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41914 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342626:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41914 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342632:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612494.342636:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41914 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342644:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41914 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342655:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff928e91fbb700) 00010000:00010000:2.0:1788612494.342658:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612494.342669:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41914 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342676:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41914 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342688:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4191b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342695:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4191b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342701:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4191b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342706:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612494.342708:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4191b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342714:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4191b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342721:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff928e9231df00) 00010000:00010000:2.0:1788612494.342723:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612494.342726:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4191b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342732:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4191b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342764:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af4190d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd895 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342788:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd895 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.342796:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff928e91fbba00) 00010000:00010000:2.0:1788612494.342798:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612494.342801:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9a00, rc 0) 00000100:00100000:2.0:1788612494.344130:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:9678:x1875495893356288:12345-192.168.202.6@tcp:101:rm.0 Request processed in 1903us (5405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612494.344141:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:1.0:1788612494.347679:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612494.347810:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893356544 00000100:00100000:0.0:1788612494.347820:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893356544 00000100:00100000:0.0:1788612494.347915:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:0.0:1788612494.347926:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:9678:x1875495893356544:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:0.0:1788612494.347984:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788612494.348016:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41922 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd895 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.348038:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6c00/0xfc956d548af418ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd879 expref: 16 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.348050:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff928e91fbba00) 00010000:00010000:0.0:1788612494.348065:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af418e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd880 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.348074:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff928e91fbb700) 00010000:00010000:0.0:1788612494.348076:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612494.348096:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7a00/0xfc956d548af41929 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.348109:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7a00/0xfc956d548af41929 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.348118:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7a00/0xfc956d548af41929 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.348131:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41930 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.348138:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41930 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.348158:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41930 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.348276:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41937 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.348285:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41937 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.348293:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41937 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788612494.349075:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788612494.349087:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 288192248457ns, next at 289192245864ns, rc = 0 00010000:00010000:0.0:1788612494.349153:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af4193e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349166:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af4193e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349175:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af4193e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349182:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af4193e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349189:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af4193e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349196:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af4193e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349238:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612494.349267:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41937 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349274:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41937 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349282:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41937 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349289:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612494.349293:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41937 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349302:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41937 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349313:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff928e91fbb900) 00010000:00010000:0.0:1788612494.349316:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788612494.349321:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41937 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349327:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7600/0xfc956d548af41937 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349344:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7a00/0xfc956d548af41929 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349350:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7a00/0xfc956d548af41929 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349356:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7a00/0xfc956d548af41929 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349367:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612494.349371:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7a00/0xfc956d548af41929 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349378:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7a00/0xfc956d548af41929 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349386:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff928e91fbb700) 00010000:00010000:0.0:1788612494.349388:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612494.349391:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7a00/0xfc956d548af41929 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.349398:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7a00/0xfc956d548af41929 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788612494.349407:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d224aebe reply state 0000000092fec9c7 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41930 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612494.349418:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612494.349498:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:9678:x1875495893356544:12345-192.168.202.6@tcp:36:rm.0 Request processed in 1571us (1826us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788612494.349507:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00010000:00010000:3.0:1788612494.349743:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612494.349750:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af4193e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.349756:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdfc00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612494.349760:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af4193e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.349766:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af4193e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.349775:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff928e91fbb900) 00010000:00010000:3.0:1788612494.349777:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788612494.349780:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af4193e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.349786:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af4193e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.349801:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612494.349803:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612494.349805:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612494.357533:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612494.357626:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893356800 00000100:00100000:1.0:1788612494.357637:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893356800 00000100:00100000:1.0:1788612494.357692:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1788612494.357703:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:9678:x1875495893356800:12345-192.168.202.6@tcp:35:rm.0 00000100:00100000:1.0:1788612494.357974:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:9678:x1875495893356800:12345-192.168.202.6@tcp:35:rm.0 Request processed in 271us (449us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788612494.357981:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1788612494.361035:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612494.361134:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893357056 00000100:00100000:2.0:1788612494.361144:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893357056 00000100:00100000:2.0:1788612494.361199:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:2.0:1788612494.361209:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:9678:x1875495893357056:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:2.0:1788612494.361282:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788612494.361307:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077000/0xfc956d548af418ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd88e expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.361330:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7e00/0xfc956d548af4189d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd86b expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.361341:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff928e91fbb700) 00010000:00010000:2.0:1788612494.361356:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9200/0xfc956d548af4185e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd85d expref: 15 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.361384:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:2.0:1788612494.361392:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612494.361415:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41945 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.361428:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41945 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.361437:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41945 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.361448:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4194c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.361455:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4194c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.361462:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4194c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.361816:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41953 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.361826:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41953 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.361833:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41953 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612494.362592:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788612494.363231:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41953 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.363263:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41953 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.363271:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41953 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.363277:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612494.363282:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41953 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.363290:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41953 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.363304:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff928e9231de00) 00010000:00010000:2.0:1788612494.363307:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788612494.363312:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41953 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.363319:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af41953 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.363352:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41945 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.363358:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41945 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.363364:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41945 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.363369:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612494.363379:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41945 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.363385:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41945 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.363393:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231df00) 00010000:00010000:2.0:1788612494.363395:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612494.363398:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41945 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.363404:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41945 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612494.363417:0:8316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000028c7332 reply state 00000000b50c17da transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4194c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612494.363425:0:8316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788612494.363574:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:9678:x1875495893357056:12345-192.168.202.6@tcp:36:rm.0 Request processed in 2362us (2546us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788612494.363583:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00010000:00010000:0.0:1788612494.363806:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41930 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.363814:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41930 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.363821:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41930 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.363874:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d6000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612494.363878:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41930 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.363886:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41930 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.363895:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff928e91fbbb00) 00010000:00010000:0.0:1788612494.363898:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612494.363901:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41930 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612494.363908:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6000/0xfc956d548af41930 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612494.381309:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914359168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612494.381381:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612494.381451:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914359168 00000100:00100000:1.0:1788612494.381459:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914359168 00000100:00100000:1.0:1788612494.381506:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788612494.381515:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914359168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612494.381537:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612494.381579:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914359168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612494.381585:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788612494.381723:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eacd2ce00 x1875495914359168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612494.381740:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914359168:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788612494.390268:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4194c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.390295:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4194c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.390303:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4194c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.390329:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612494.391309:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4194c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.391321:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4194c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.391339:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff928e9231d700) 00010000:00010000:3.0:1788612494.391342:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612494.391346:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4194c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612494.391353:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4194c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612494.956340:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612495.984121:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612497.004947:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612498.031148:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612498.481033:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612498.481058:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914359296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612498.481131:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612498.481223:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914359296 00000100:00100000:1.0:1788612498.481232:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914359296 00000100:00100000:1.0:1788612498.481289:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788612498.481299:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914359296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612498.481348:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612498.481397:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914359296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612498.481404:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788612498.481428:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788612498.481459:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ec01f4380 x1875495914359296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612498.481479:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914359296:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788612498.893231:0:11618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1788612498.989053:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914359808:0@lo:400:kworker.0 00000100:00100000:2.0:1788612498.989127:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612498.989188:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788612498.989195:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914359424:0@lo:400:kworker.0 00000100:00100000:2.0:1788612498.989226:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612498.989248:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914359936:0@lo:400:kworker.0 00000100:00100000:2.0:1788612498.989271:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612498.989321:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914359552:0@lo:400:kworker.0 00000100:00100000:2.0:1788612498.989356:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612498.989376:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612498.989381:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e98ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914359680:0@lo:400:kworker.0 00000100:00100000:2.0:1788612498.989402:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612498.989434:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914359808 00000100:00100000:2.0:1788612498.989443:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914359808 00000100:00100000:2.0:1788612498.989494:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914359552 00000100:00100000:2.0:1788612498.989497:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914359552 00000100:00100000:2.0:1788612498.989510:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914359680 00000100:00100000:2.0:1788612498.989513:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914359680 00000100:00100000:2.0:1788612498.989528:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788612498.989535:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914359808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612498.989585:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914359808:12345-0@lo:400:kworker.0 Request processed in 50us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612498.989592:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788612498.989611:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788612498.989619:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914359552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612498.989651:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914359552:12345-0@lo:400:kworker.0 Request processed in 34us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612498.989658:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788612498.989669:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788612498.989688:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914359680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612498.989727:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914359680:12345-0@lo:400:kworker.0 Request processed in 52us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612498.989734:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788612498.989757:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914359424 00000100:00100000:2.0:1788612498.989767:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914359424 00000100:00100000:2.0:1788612498.989797:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788612498.989803:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914359424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612498.989834:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914359424:12345-0@lo:400:kworker.0 Request processed in 31us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612498.989863:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:2.0:1788612498.989891:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612498.989927:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914359680:0@lo:400:kworker.0 00000100:00100000:2.0:1788612498.989938:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914359552:0@lo:400:kworker.0 00000100:00100000:2.0:1788612498.989970:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914359424:0@lo:400:kworker.0 00000100:00100000:2.0:1788612498.989980:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914359808:0@lo:400:kworker.0 00000100:00100000:1.0:1788612498.990420:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914359936 00000100:00100000:1.0:1788612498.990426:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914359936 00000100:00100000:1.0:1788612498.990484:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788612498.990492:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914359936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612498.990537:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914359936:12345-0@lo:400:kworker.0 Request processed in 47us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612498.990543:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788612498.990651:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788612498.990798:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e98ef5880 x1875495914359936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612498.990811:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e98ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914359936:0@lo:400:kworker.0 00010000:00010000:2.0:1788612499.054615:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612499.393350:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612499.393391:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612499.393414:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612499.393431:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612499.393483:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893357184 00000100:00100000:2.0:1788612499.393493:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893357184 00000100:00100000:2.0:1788612499.393547:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 248 00000100:00100000:2.0:1788612499.393555:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893357184:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612499.393619:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893357184:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 65us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612499.393627:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 248 00000100:00100000:2.0:1788612499.393655:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893357312 00000100:00100000:2.0:1788612499.393671:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893357312 00000100:00100000:2.0:1788612499.393701:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893357568 00000100:00100000:2.0:1788612499.393703:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893357568 00000100:00100000:2.0:1788612499.393721:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 100 00000100:00100000:2.0:1788612499.393726:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:2355:x1875495893357312:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612499.393760:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:2355:x1875495893357312:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 33us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612499.393765:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 100 00000100:00100000:2.0:1788612499.393777:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00100000:2.0:1788612499.393782:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893357568:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612499.393819:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893357568:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 36us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612499.393825:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00080000:2.0:1788612499.393972:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612499.394704:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893357440 00000100:00100000:3.0:1788612499.394711:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893357440 00000100:00080000:2.0:1788612499.395035:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612499.395146:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:3.0:1788612499.395158:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893357440:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612499.395211:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893357440:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 58us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612499.395218:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00000004:00080000:1.0:1788612499.500033:0:8112:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 293343191192ns, next at 294343186262ns, rc = 0 00000100:00100000:1.0:1788612499.500066:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914360064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612499.500133:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612499.500209:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914360064 00000100:00100000:1.0:1788612499.500217:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914360064 00000100:00100000:1.0:1788612499.500262:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788612499.500271:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914360064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612499.500305:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612499.500368:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914360064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612499.500376:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788612499.500514:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eacd2e680 x1875495914360064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612499.500533:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914360064:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788612499.586357:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1788612499.586370:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:2.0:1788612499.586398:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788612499.586403:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:2.0:1788612499.586409:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:3.0:1788612499.587039:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914360192:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788612499.587117:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612499.587902:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914360192 00000100:00100000:0.0:1788612499.587913:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914360192 00000100:00100000:0.0:1788612499.587978:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612499.587988:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914360192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788612499.588017:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788612499.588051:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9c0f8e, atime: 0x6a9c0f8e, ctime: 0x6a9c0f8e, blocks: 0x1 00010000:00010000:0.0:1788612499.588060:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d0db1a/0xfc956d548af4195a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.588076:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=293s v=(0 0) 00010000:00010000:0.0:1788612499.588081:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612499.588088:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d0db1a/0xfc956d548af4195a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.588121:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3d0db1a/0xfc956d548af4195a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.588132:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d0db1a/0xfc956d548af4195a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.588140:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d0db1a/0xfc956d548af4195a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.588163:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788612499.588723:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875495914360192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 735us (1605us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788612499.588732:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788612499.588782:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff928eacd2d180/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788612499.588788:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914360192:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788612499.589899:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612499.589910:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3d0db1a/0xfc956d548af4195a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612499.589922:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612499.589927:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d0db1a/0xfc956d548af4195a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612499.589962:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d0db1a/0xfc956d548af4195a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612499.589985:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3d0db1a/0xfc956d548af4195a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612499.589994:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3d0db1a/0xfc956d548af4195a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612499.590016:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612499.590018:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612499.590020:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788612499.973683:0:11667:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5e78c150 20000000:00000080:0.0:1788612499.973701:0:11667:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff928ea7893000 uarg=0000000000000000 20000000:01000000:0.0:1788612499.973741:0:11667:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788612499.973748:0:11667:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788612499.973754:0:11667:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788612499.980226:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788612499.980402:0:11667:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788612499.988706:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788612499.988751:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788612499.988795:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788612499.988812:0:11667:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788612499.989149:0:11667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.989170:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ec21e9800/0xfc956d548af417fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd848 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.989178:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e80030000/0xfc956d548af41803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd84f expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.989187:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e80030400/0xfc956d548af41811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4180a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.989193:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e80030200/0xfc956d548af4181f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41818 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.989199:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ec21e8600/0xfc956d548af4182d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41826 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.989206:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.989243:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ec21e8600/0xfc956d548af4182d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af41826 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.989256:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928ec21e8600/0xfc956d548af4182d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af41826 expref: 18 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612499.989269:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875495914360320:0@lo:104: 00000100:00100000:0.0:1788612499.989328:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612499.989395:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e80030200/0xfc956d548af4181f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af41818 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.989412:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e80030200/0xfc956d548af4181f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af41818 expref: 18 pid: 5844 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612499.989421:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875495914360448:0@lo:104: 00000100:00100000:0.0:1788612499.989448:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612499.989551:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914360320 00000100:00100000:2.0:1788612499.989558:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914360320 00000100:00100000:3.0:1788612499.989590:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914360448 00000100:00100000:3.0:1788612499.989598:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914360448 00000100:00100000:2.0:1788612499.989616:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788612499.989633:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+4:11667:x1875495914360320:12345-0@lo:104: 00010000:00010000:2.0:1788612499.989645:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4182d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612499.989695:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612499.989700:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22c69a0a-d366-4936-9310-01935a424f88+4:11667:x1875495914360320:12345-0@lo:104: Request processed in 76us (372us total) trans 0 rc 0/0 00010000:00010000:0.0:1788612499.990427:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612499.990434:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4182d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.990443:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788612499.990447:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af4182d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.990456:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af4182d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612499.990464:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af4182d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612499.990470:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788612499.990502:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4182d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.990510:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612499.990530:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4182d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.990537:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d7200/0xfc956d548af41826 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4182d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.990567:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612499.990569:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612499.990571:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612499.990580:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612499.990595:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914360576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612499.990647:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612499.990689:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914360576 00000100:00100000:0.0:1788612499.990694:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914360576 00010000:00010000:0.0:1788612499.990713:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ec21e8600/0xfc956d548af4182d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41826 expref: 19 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612499.990735:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788612499.990742:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22c69a0a-d366-4936-9310-01935a424f88+19:3306:x1875495914360576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612499.990753:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612499.990758:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ec21e8600/0xfc956d548af4182d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41826 expref: 19 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.990768:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ec21e8600/0xfc956d548af4182d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af41826 expref: 19 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.990784:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612499.990813:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22c69a0a-d366-4936-9310-01935a424f88+19:3306:x1875495914360576:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612499.990819:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788612499.990870:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914360576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612499.991026:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788612499.991038:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:22c69a0a-d366-4936-9310-01935a424f88+4:11667:x1875495914360448:12345-0@lo:104: 00010000:00010000:3.0:1788612499.991050:0:7634:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4181f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612499.991101:0:7634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788612499.991107:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:22c69a0a-d366-4936-9310-01935a424f88+4:11667:x1875495914360448:12345-0@lo:104: Request processed in 74us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612499.991114:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788612499.991256:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e80030400/0xfc956d548af41811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af4180a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612499.991267:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff928e80030400/0xfc956d548af41811 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af4180a expref: 18 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612499.991277:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875495914360704:0@lo:104: 00000100:00100000:3.0:1788612499.991306:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612499.991437:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e80030000/0xfc956d548af41803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd84f expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612499.991449:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928e80030000/0xfc956d548af41803 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd84f expref: 12 pid: 5847 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612499.991459:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bcb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875495914360832:192.168.202.6@tcp:104: 00010000:00010000:3.0:1788612499.991536:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ec21e9800/0xfc956d548af417fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd848 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612499.991546:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928ec21e9800/0xfc956d548af417fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd848 expref: 12 pid: 5847 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612499.991554:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875495914360960:192.168.202.6@tcp:104: 00000100:00100000:3.0:1788612499.991578:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c25840 going to sleep for 11 seconds 00010000:00010000:3.0:1788612499.991594:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e8600/0xfc956d548af4182d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af41826 expref: 18 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612499.991605:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875495914360320:0@lo:104: 00000100:00100000:3.0:1788612499.991612:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875495914360448:0@lo:104: 00010000:00010000:3.0:1788612499.991670:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612499.991675:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4181f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612499.991681:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7c00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788612499.991684:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af4181f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612499.991693:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af4181f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612499.991700:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af4181f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612499.991706:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612499.991728:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4181f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612499.991739:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612499.991755:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4181f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612499.991762:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d7c00/0xfc956d548af41818 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4181f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612499.991772:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612499.991774:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612499.991775:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612499.991785:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612499.991796:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914361088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612499.991827:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612499.993224:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914361088 00000100:00100000:3.0:1788612499.993237:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914361088 00010000:00010000:3.0:1788612499.993275:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e80030200/0xfc956d548af4181f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41818 expref: 18 pid: 5844 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612499.993311:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788612499.993320:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+18:3305:x1875495914361088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612499.993333:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612499.993338:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e80030200/0xfc956d548af4181f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af41818 expref: 18 pid: 5844 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612499.993380:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e80030200/0xfc956d548af4181f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af41818 expref: 18 pid: 5844 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612499.993395:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e80030200/0xfc956d548af4181f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af41818 expref: 18 pid: 5844 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612499.993425:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612499.993472:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22c69a0a-d366-4936-9310-01935a424f88+17:3305:x1875495914361088:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612499.993479:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788612499.993651:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788612499.993679:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788612499.993693:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914360704 00000100:00100000:2.0:1788612499.993697:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914360704 00000100:00100000:3.0:1788612499.994148:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914361088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612499.994381:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612499.994391:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea773f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+3:11667:x1875495914360704:12345-0@lo:104: 00010000:00010000:0.0:1788612499.994408:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41811 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.994653:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788612499.994660:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea773f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22c69a0a-d366-4936-9310-01935a424f88+3:11667:x1875495914360704:12345-0@lo:104: Request processed in 272us (3353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612499.994667:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788612499.994719:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612499.994725:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af41811 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.994732:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8c00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788612499.994736:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af41811 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.994745:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af41811 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612499.994752:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af41811 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612499.994757:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788612499.994791:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41811 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.994798:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612499.994815:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41811 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.994822:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928ec21e8c00/0xfc956d548af4180a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af41811 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.994863:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612499.994865:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612499.994866:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612499.994894:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914361216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612499.994931:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612499.994973:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914361216 00000100:00100000:0.0:1788612499.994978:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914361216 00010000:00010000:0.0:1788612499.994995:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e80030400/0xfc956d548af41811 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af4180a expref: 17 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612499.995016:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788612499.995022:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9238e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+17:3307:x1875495914361216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612499.995031:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612499.995036:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e80030400/0xfc956d548af41811 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af4180a expref: 17 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.995056:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e80030400/0xfc956d548af41811 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af4180a expref: 17 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612499.995073:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612499.995101:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9238e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22c69a0a-d366-4936-9310-01935a424f88+17:3307:x1875495914361216:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612499.995107:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788612499.995155:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914361216:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612499.999826:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e80030400/0xfc956d548af41811 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af4180a expref: 16 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612500.000205:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875495914360704:0@lo:104: 00000100:00100000:1.0:1788612500.000709:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612500.000791:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893357696 00000100:00100000:0.0:1788612500.000799:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893357696 00010000:00010000:0.0:1788612500.000873:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e80030000/0xfc956d548af41803 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd84f expref: 13 pid: 5847 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612500.000938:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:0.0:1788612500.000950:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893357696:12345-192.168.202.6@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788612500.000956:0:5839:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1788612500.000965:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788612500.000968:0:5839:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788612500.000974:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e80030000/0xfc956d548af41803 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd84f expref: 13 pid: 5847 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612500.000989:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e80030000/0xfc956d548af41803 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd84f expref: 13 pid: 5847 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612500.001010:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612500.001080:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893357696:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 132us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612500.001088:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:1.0:1788612500.001474:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612500.001538:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893357824 00000100:00100000:2.0:1788612500.001544:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893357824 00010000:00010000:2.0:1788612500.001564:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ec21e9800/0xfc956d548af417fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd848 expref: 13 pid: 5847 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612500.001596:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:2.0:1788612500.001603:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893357824:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612500.001612:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612500.001616:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ec21e9800/0xfc956d548af417fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd848 expref: 13 pid: 5847 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612500.001626:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ec21e9800/0xfc956d548af417fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd848 expref: 13 pid: 5847 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612500.001641:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612500.001651:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612500.001666:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612500.001674:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612500.001680:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612500.001687:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612500.001700:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612500.001705:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612500.001711:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e80030000/0xfc956d548af41803 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd84f expref: 13 pid: 5847 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612500.001715:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612500.001733:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612500.001735:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bcb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875495914360832:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612500.001752:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612500.001759:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e9800/0xfc956d548af417fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd848 expref: 12 pid: 5847 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612500.001770:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875495914360960:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612500.001782:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93581484-5c48-42e2-a9bb-7e5e07222f81+11:2355:x1875495893357824:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 178us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612500.001791:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00010000:00010000:3.0:1788612500.001820:0:11667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612500.001832:0:11667:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612500.001859:0:11667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612500.001866:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea7bdf000/0xfc956d548af41961 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612500.080709:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612501.100244:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788612501.100322:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788612501.100327:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928d85299000 from 7 10000000:01000000:3.0:1788612501.100332:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788612501.100415:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612501.100428:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612501.100440:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612501.100465:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914361344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.100539:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612501.100591:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8541fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612501.100722:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914361344 00000100:00100000:2.0:1788612501.100730:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914361344 00000100:00100000:2.0:1788612501.100868:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788612501.100878:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+16:5849:x1875495914361344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612501.100890:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612501.100903:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e8400/0xfc956d548af4196f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41968 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612501.100928:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e8400/0xfc956d548af4196f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41968 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612501.100938:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e8400/0xfc956d548af4196f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41968 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612501.100947:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8400, rc 0) 00000100:00100000:2.0:1788612501.101017:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914361344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612501.101091:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788612501.101223:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914361344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612501.101237:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4196f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612501.101246:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4196f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612501.101368:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914361472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.101406:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612501.101497:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8541fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612501.111242:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914361472 00000100:00100000:1.0:1788612501.111259:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914361472 00000100:00100000:1.0:1788612501.111343:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788612501.111354:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914361472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612501.111701:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914361472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 348us (10293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612501.111709:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788612501.112019:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914361472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.112094:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914361600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.112141:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612501.112177:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8541fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612501.112295:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914361600 00000100:00100000:0.0:1788612501.112301:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914361600 00000100:00100000:0.0:1788612501.112337:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788612501.112345:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914361600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612501.112517:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914361600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612501.112525:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788612501.112809:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914361600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.114561:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:11681:1875495914361728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612501.114638:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612501.114680:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8541fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612501.114867:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914361728 00000100:00100000:0.0:1788612501.114873:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914361728 00000100:00100000:0.0:1788612501.114923:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788612501.114932:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+17:11681:x1875495914361728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612501.115154:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+17:11681:x1875495914361728:12345-0@lo:502:llog_process_th.0 Request processed in 223us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612501.115168:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788612501.115890:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:11681:1875495914361728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612501.115928:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612501.115938:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612501.115940:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788612501.115949:0:11681:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff928d85299000 00000020:00000080:3.0:1788612501.115952:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788612501.116122:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:11681:1875495914361856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612501.116170:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612501.116209:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8541fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612501.116271:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914361856 00000100:00100000:2.0:1788612501.116278:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914361856 00000100:00100000:2.0:1788612501.116329:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788612501.116338:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+17:11681:x1875495914361856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612501.116533:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+17:11681:x1875495914361856:12345-0@lo:502:llog_process_th.0 Request processed in 186us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612501.116541:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788612501.117188:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:11681:1875495914361856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612501.117217:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612501.117223:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612501.117224:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788612501.117230:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788612501.118166:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788612501.118194:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612501.118205:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4196f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612501.118218:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4196f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612501.118229:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788612501.118232:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928e9162f000 from 7 10000000:01000000:2.0:1788612501.118235:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612501.118266:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612501.118275:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612501.118285:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612501.118408:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebf81ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914361984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612501.118468:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612501.122545:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d87f5e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788612501.127018:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914361984 00000100:00100000:0.0:1788612501.127101:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914361984 00000100:00100000:0.0:1788612501.127381:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788612501.127395:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+17:5849:x1875495914361984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612501.127414:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612501.127435:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea7bde000/0xfc956d548af4197d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41976 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612501.127466:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea7bde000/0xfc956d548af4197d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41976 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612501.127476:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea7bde000/0xfc956d548af4197d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41976 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612501.127486:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bde000, rc 0) 00000100:00100000:0.0:1788612501.128212:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914361984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 818us (9740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612501.128220:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788612501.140087:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebf81ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914361984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612501.140117:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4197d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612501.140152:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4197d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612501.140237:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914362112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.140481:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612501.140524:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8541fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612501.140587:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914362112 00000100:00100000:1.0:1788612501.140595:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914362112 00000100:00100000:1.0:1788612501.140646:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788612501.140665:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914362112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612501.140956:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914362112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612501.140965:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788612501.141755:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914362112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.141799:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914362240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.141875:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612501.141902:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8541fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612501.141980:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914362240 00000100:00100000:1.0:1788612501.141985:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914362240 00000100:00100000:1.0:1788612501.142011:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788612501.142018:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914362240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612501.142192:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914362240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612501.142200:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788612501.142369:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914362240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612501.144825:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:11684:1875495914362368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612501.144928:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612501.144961:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec0357a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612501.154463:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914362368 00000100:00100000:3.0:1788612501.154479:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914362368 00000100:00100000:3.0:1788612501.154957:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788612501.154971:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:11684:x1875495914362368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612501.155398:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:11684:x1875495914362368:12345-0@lo:502:llog_process_th.0 Request processed in 430us (10469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612501.155407:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788612501.155502:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:11684:1875495914362368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788612501.155548:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612501.155558:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612501.155560:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788612501.155567:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff928e9162f000 00000020:00000080:1.0:1788612501.155570:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788612501.158244:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd2dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:11684:1875495914362496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612501.158387:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612501.163095:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c7eb40 going to sleep for 11 seconds 00000040:00080000:2.0:1788612501.166263:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788612501.169263:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914362496 00000100:00100000:0.0:1788612501.169278:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914362496 00000100:00100000:0.0:1788612501.169341:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788612501.169351:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+18:11684:x1875495914362496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612501.169641:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+18:11684:x1875495914362496:12345-0@lo:502:llog_process_th.0 Request processed in 291us (11253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612501.169655:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788612501.169736:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd2dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:11684:1875495914362496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788612501.169774:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612501.171877:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612501.171881:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788612501.171887:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788612501.175660:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788612501.175693:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788612501.175705:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4197d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612501.175721:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4197d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612501.175741:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788612501.175744:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928e98e67000 from 7 10000000:01000000:3.0:1788612501.175746:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788612501.175787:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612501.175794:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612501.175804:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612501.175828:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914362624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.175939:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612501.175977:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8541fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612501.176007:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914362624 00000100:00100000:3.0:1788612501.176014:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914362624 00000100:00100000:3.0:1788612501.176061:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788612501.176068:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+18:5849:x1875495914362624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612501.176080:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612501.176092:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea0077c00/0xfc956d548af4198b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af41984 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612501.176115:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea0077c00/0xfc956d548af4198b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af41984 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612501.176127:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea0077c00/0xfc956d548af4198b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af41984 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612501.176146:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077c00, rc 0) 00000100:00100000:3.0:1788612501.176186:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914362624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612501.176193:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788612501.176227:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914362624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612501.176240:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612501.176248:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612501.176407:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914362752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.176433:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612501.176442:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8541fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612501.176461:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914362752 00000100:00100000:3.0:1788612501.176466:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914362752 00000100:00100000:3.0:1788612501.176482:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788612501.176488:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914362752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.176715:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914362752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612501.176723:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788612501.176747:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914362752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.176774:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914362880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.176812:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612501.176830:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8541fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612501.176869:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914362880 00000100:00100000:3.0:1788612501.176873:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914362880 00000100:00100000:3.0:1788612501.176888:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788612501.176895:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914362880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.187226:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:5849:x1875495914362880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 10319us (10401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612501.187242:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788612501.187945:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22c69a0a-d366-4936-9310-01935a424f88:5849:1875495914362880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.190692:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bcb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:11687:1875495914363008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612501.192403:0:11687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612501.193432:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8541f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612501.194418:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914363008 00000100:00100000:2.0:1788612501.194430:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914363008 00000100:00100000:2.0:1788612501.194535:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788612501.194548:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:11687:x1875495914363008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612501.194904:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:11687:x1875495914363008:12345-0@lo:502:llog_process_th.0 Request processed in 359us (4124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612501.194912:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788612501.195519:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bcb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:11687:1875495914363008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612501.195557:0:11687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612501.195570:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612501.195572:0:11687:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788612501.195581:0:11687:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff928e98e67000 00000020:00000080:3.0:1788612501.195583:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788612501.195712:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bcb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:11687:1875495914363136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612501.195762:0:11687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612501.200443:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914363136 00000100:00100000:0.0:1788612501.200458:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914363136 00000100:00100000:0.0:1788612501.200517:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788612501.200526:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:11687:x1875495914363136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612501.200774:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:11687:x1875495914363136:12345-0@lo:502:llog_process_th.0 Request processed in 248us (5010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612501.203879:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788612501.205912:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8541f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612501.205957:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bcb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22c69a0a-d366-4936-9310-01935a424f88:11687:1875495914363136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788612501.206001:0:11687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612501.206010:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612501.206013:0:11687:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788612501.206019:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788612501.207012:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788612501.207052:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788612501.207070:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612501.207083:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612501.562536:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612501.567625:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893357952 00000100:00100000:1.0:1788612501.567643:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893357952 00000100:00100000:1.0:1788612501.567717:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 264 00000100:00100000:1.0:1788612501.567728:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+11:5596:x1875495893357952:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612501.567746:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612501.567765:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b61e00/0xfc956d548af41992 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd89c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612501.567798:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b61e00/0xfc956d548af41992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd89c expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612501.567809:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b61e00/0xfc956d548af41992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd89c expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612501.567818:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61e00, rc 0) 00000100:00100000:1.0:1788612501.567949:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+12:5596:x1875495893357952:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 222us (5423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612501.567956:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 264 00000100:00100000:0.0:1788612501.572451:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612501.573498:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893358080 00000100:00100000:3.0:1788612501.573511:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893358080 00000100:00100000:3.0:1788612501.573708:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 265 00000100:00100000:3.0:1788612501.573720:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+12:5596:x1875495893358080:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.574448:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+12:5596:x1875495893358080:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 726us (2003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612501.574457:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 265 00000100:00100000:0.0:1788612501.585109:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612501.586750:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893358208 00000100:00100000:2.0:1788612501.586768:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893358208 00000100:00100000:2.0:1788612501.586986:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 266 00000100:00100000:2.0:1788612501.586999:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+12:5596:x1875495893358208:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612501.587243:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+12:5596:x1875495893358208:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 247us (2145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612501.587262:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 266 00000100:00100000:0.0:1788612501.599502:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612501.599976:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893358336 00000100:00100000:3.0:1788612501.600645:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893358336 00000100:00100000:3.0:1788612501.600718:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 267 00000100:00100000:3.0:1788612501.600727:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+12:9948:x1875495893358336:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788612501.601062:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+12:9948:x1875495893358336:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 335us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612501.601071:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 267 00000100:00100000:0.0:1788612501.604942:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612501.605056:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893358464 00000100:00100000:1.0:1788612501.605066:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893358464 00000100:00100000:1.0:1788612501.605123:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 268 00000100:00100000:1.0:1788612501.605132:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+12:9948:x1875495893358464:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788612501.605390:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+12:9948:x1875495893358464:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 248us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612501.605399:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 268 00000100:00100000:0.0:1788612501.619228:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612501.620265:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893358592 00000100:00100000:2.0:1788612501.620280:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893358592 00000100:00100000:2.0:1788612501.620352:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 269 00000100:00100000:2.0:1788612501.620364:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+12:5596:x1875495893358592:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612501.620387:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612501.620408:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e8800/0xfc956d548af41999 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd8a3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612501.620440:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e8800/0xfc956d548af41999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8a3 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612501.620451:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e8800/0xfc956d548af41999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8a3 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612501.620461:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8800, rc 0) 00000100:00100000:2.0:1788612501.620542:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:5596:x1875495893358592:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 180us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612501.620549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 269 00000100:00100000:0.0:1788612501.624086:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612501.624173:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893358720 00000100:00100000:3.0:1788612501.624184:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893358720 00000100:00100000:3.0:1788612501.624241:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 270 00000100:00100000:3.0:1788612501.624251:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:5596:x1875495893358720:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612501.624596:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:5596:x1875495893358720:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 345us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612501.624603:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 270 00000100:00100000:0.0:1788612501.629358:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612501.638255:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893358848 00000100:00100000:1.0:1788612501.638289:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893358848 00000100:00100000:1.0:1788612501.638362:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 271 00000100:00100000:1.0:1788612501.638373:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:5596:x1875495893358848:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612501.638625:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:5596:x1875495893358848:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 252us (9276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612501.638633:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 271 00000100:00100000:0.0:1788612501.642751:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612501.653499:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893358976 00000100:00100000:2.0:1788612501.653520:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893358976 00000100:00100000:2.0:1788612501.653605:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 272 00000100:00100000:2.0:1788612501.653616:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:9951:x1875495893358976:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612501.653897:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:9951:x1875495893358976:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 282us (11161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612501.653904:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 272 00000100:00100000:0.0:1788612501.666058:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612501.667612:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893359104 00000100:00100000:3.0:1788612501.667627:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893359104 00000100:00100000:3.0:1788612501.667702:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 273 00000100:00100000:3.0:1788612501.667713:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:9951:x1875495893359104:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788612501.668075:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:9951:x1875495893359104:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 363us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612501.668085:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 273 00010000:00010000:3.0:1788612502.124320:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788612502.190816:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788612503.148678:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612503.596541:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914363264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612503.596615:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612503.596744:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914363264 00000100:00100000:1.0:1788612503.596753:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914363264 00000100:00100000:1.0:1788612503.596814:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788612503.596833:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914363264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612503.596898:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612503.596950:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914363264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612503.596957:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788612503.597324:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788612503.597356:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ebfc4fb80 x1875495914363264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612503.597374:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914363264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612504.108159:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914363648:0@lo:400:kworker.0 00000100:00100000:3.0:1788612504.108164:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914363776:0@lo:400:kworker.0 00000100:00100000:1.0:1788612504.108280:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914363520:0@lo:400:kworker.0 00000100:00100000:0.0:1788612504.108344:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914363392:0@lo:400:kworker.0 00000100:00100000:2.0:1788612504.113884:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612504.113994:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914363648 00000100:00100000:2.0:1788612504.114003:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914363648 00000100:00100000:2.0:1788612504.114061:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788612504.114074:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914363648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612504.114139:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914363648:12345-0@lo:400:kworker.0 Request processed in 69us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612504.114146:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788612504.114173:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612504.114206:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914363648:0@lo:400:kworker.0 00000100:00100000:3.0:1788612504.116478:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612504.116656:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914363776 00000100:00100000:2.0:1788612504.116666:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914363776 00000100:00100000:2.0:1788612504.116747:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788612504.116757:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914363776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612504.116822:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914363776:12345-0@lo:400:kworker.0 Request processed in 67us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612504.116830:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1788612504.117038:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612504.117086:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914363776:0@lo:400:kworker.0 00000100:00100000:1.0:1788612504.117750:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612504.117865:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914363520 00000100:00100000:2.0:1788612504.117880:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914363520 00000100:00100000:2.0:1788612504.117927:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788612504.117935:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914363520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612504.118036:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914363520:12345-0@lo:400:kworker.0 Request processed in 102us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612504.118043:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788612504.118169:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612504.118368:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914363904:0@lo:400:kworker.0 00000100:00100000:0.0:1788612504.118419:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612504.118654:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914363520:0@lo:400:kworker.0 00000100:00100000:3.0:1788612504.119123:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914363904 00000100:00100000:3.0:1788612504.119130:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914363904 00000100:00100000:3.0:1788612504.119206:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788612504.119216:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875495914363904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612504.119267:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875495914363904:12345-0@lo:400:kworker.0 Request processed in 52us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612504.119274:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788612504.119350:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612504.119379:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914363904:0@lo:400:kworker.0 00000100:00100000:2.0:1788612504.122637:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914363392 00000100:00100000:2.0:1788612504.122653:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914363392 00000100:00100000:2.0:1788612504.122725:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788612504.122736:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914363392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612504.123337:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914363392:12345-0@lo:400:kworker.0 Request processed in 601us (5165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612504.123347:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788612504.124184:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914363392:0@lo:400:kworker.0 00010000:00010000:3.0:1788612504.172207:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612504.508944:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612504.508987:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612504.509015:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612504.509043:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612504.509119:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893359616 00000100:00100000:2.0:1788612504.509130:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893359616 00000100:00100000:2.0:1788612504.509201:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 105 00000100:00100000:2.0:1788612504.509211:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893359616:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612504.509286:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893359616:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612504.509293:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 105 00000100:00100000:3.0:1788612504.509308:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893359360 00000100:00100000:3.0:1788612504.509316:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893359360 00000100:00100000:2.0:1788612504.509321:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893359232 00000100:00100000:2.0:1788612504.509327:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893359232 00000100:00100000:3.0:1788612504.509357:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 106 00000100:00100000:2.0:1788612504.509362:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 275 00000100:00100000:3.0:1788612504.509371:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2353:x1875495893359360:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612504.509375:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2353:x1875495893359232:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612504.509411:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2353:x1875495893359360:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 43us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612504.509419:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 106 00000100:00080000:0.0:1788612504.509449:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612504.509542:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893359488 00000100:00100000:1.0:1788612504.509546:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893359488 00000100:00100000:1.0:1788612504.509589:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:1.0:1788612504.509596:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2353:x1875495893359488:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:0.0:1788612504.509719:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612504.510659:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2353:x1875495893359232:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 1283us (1719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612504.510683:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 275 00000100:00100000:1.0:1788612504.514952:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2353:x1875495893359488:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 5341us (5948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612504.514967:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:0.0:1788612504.620277:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612504.620302:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914364032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612504.620373:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612504.620480:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914364032 00000100:00100000:3.0:1788612504.620489:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914364032 00000100:00100000:3.0:1788612504.620549:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788612504.620561:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875495914364032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612504.620596:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612504.620650:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875495914364032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612504.620658:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788612504.622585:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914364032:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788612504.651630:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1788612505.196089:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612506.220265:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612507.244050:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612508.268080:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612508.716255:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612508.716276:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914364160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612508.716355:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612508.716417:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914364160 00000100:00100000:2.0:1788612508.716425:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914364160 00000100:00100000:2.0:1788612508.716477:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788612508.716485:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914364160:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788612508.716509:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788612508.716525:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612508.716576:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914364160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612508.716580:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788612508.716742:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ebfc4c380 x1875495914364160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612508.716761:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914364160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612509.228185:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914364288:0@lo:400:kworker.0 00000100:00100000:3.0:1788612509.228281:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612509.228287:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914364416:0@lo:400:kworker.0 00000100:00100000:0.0:1788612509.228331:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612509.228366:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612509.228375:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914364544:0@lo:400:kworker.0 00000100:00100000:0.0:1788612509.228401:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612509.228665:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914364416 00000100:00100000:3.0:1788612509.228672:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914364416 00000100:00100000:3.0:1788612509.228738:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914364544 00000100:00100000:3.0:1788612509.228744:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914364544 00000100:00100000:3.0:1788612509.228797:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788612509.228810:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914364416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612509.228812:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914364928:0@lo:400:kworker.0 00000100:00100000:1.0:1788612509.228877:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612509.228915:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914364416:12345-0@lo:400:kworker.0 Request processed in 106us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612509.228923:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914364416:0@lo:400:kworker.0 00000100:00100000:3.0:1788612509.228932:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788612509.228962:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788612509.228972:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914364544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612509.228975:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914364928 00000100:00100000:1.0:1788612509.228982:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914364928 00000100:00100000:1.0:1788612509.229019:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788612509.229029:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914364544:12345-0@lo:400:kworker.0 Request processed in 54us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612509.229030:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914364928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612509.229044:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788612509.229074:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914364928:12345-0@lo:400:kworker.0 Request processed in 46us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612509.229098:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788612509.229106:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff928eacd2d180, transno 4294967300 00000100:00100000:3.0:1788612509.229128:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914364928:0@lo:400:kworker.0 00000100:00100000:3.0:1788612509.229160:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914364544:0@lo:400:kworker.0 00000100:00100000:1.0:1788612509.229436:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788612509.229464:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612509.229469:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612509.229495:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914364800:0@lo:400:kworker.0 00000100:00100000:1.0:1788612509.229538:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612509.229712:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612509.229721:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914364672:0@lo:400:kworker.0 00000100:00100000:3.0:1788612509.229723:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914364800 00000100:00100000:3.0:1788612509.229731:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914364800 00000100:00100000:1.0:1788612509.229750:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788612509.229788:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612509.229789:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788612509.230001:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914364800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612509.230017:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914364288 00000100:00100000:2.0:1788612509.230024:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914364288 00000100:00100000:3.0:1788612509.230059:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914364800:12345-0@lo:400:kworker.0 Request processed in 252us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612509.230065:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788612509.230071:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788612509.230089:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3308:x1875495914364288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612509.230137:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3308:x1875495914364288:12345-0@lo:400:kworker.0 Request processed in 64us (1868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612509.230144:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788612509.230372:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914364672 00000100:00100000:0.0:1788612509.230378:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914364672 00000100:00100000:0.0:1788612509.230414:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788612509.230422:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914364672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612509.230480:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914364672:12345-0@lo:400:kworker.0 Request processed in 59us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612509.230500:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788612509.230693:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928e90c57b80 x1875495914364672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612509.230706:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914364672:0@lo:400:kworker.0 00000100:00100000:1.0:1788612509.230718:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914364800:0@lo:400:kworker.0 00000100:00100000:1.0:1788612509.230727:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914364288:0@lo:400:kworker.0 00010000:00010000:0.0:1788612509.292063:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612509.627829:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612509.627904:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612509.627952:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612509.628080:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893360000 00000100:00100000:3.0:1788612509.628090:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893360000 00000100:00100000:3.0:1788612509.628175:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:3.0:1788612509.628185:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893360000:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612509.628252:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893360000:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 69us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612509.628259:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:2.0:1788612509.628403:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893359744 00000100:00100000:2.0:1788612509.628419:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893359744 00000100:00100000:2.0:1788612509.628459:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 277 00000100:00100000:2.0:1788612509.628467:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e86f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893359744:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612509.628504:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e86f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893359744:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 38us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612509.628510:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 277 00000100:00100000:1.0:1788612509.628606:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893359872 00000100:00100000:1.0:1788612509.628623:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893359872 00000100:00100000:1.0:1788612509.628667:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 110 00000100:00100000:1.0:1788612509.628675:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2356:x1875495893359872:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612509.628714:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2356:x1875495893359872:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 39us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612509.628722:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 110 00000100:00080000:0.0:1788612509.631069:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612509.631081:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612509.635245:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612509.637507:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893360128 00000100:00100000:0.0:1788612509.637533:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893360128 00000100:00100000:0.0:1788612509.637639:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 111 00000100:00100000:0.0:1788612509.637651:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78d21d21-8748-4720-b30a-c0081165c376+5:2356:x1875495893360128:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612509.637744:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78d21d21-8748-4720-b30a-c0081165c376+5:2356:x1875495893360128:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 95us (2509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612509.637751:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 111 00000100:00080000:1.0:1788612509.639040:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612509.740271:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612509.740298:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914365056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612509.740368:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612509.741363:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914365056 00000100:00100000:1.0:1788612509.741382:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914365056 00000100:00100000:1.0:1788612509.741443:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788612509.741453:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914365056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612509.741493:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612509.741575:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914365056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612509.741599:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914365056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612509.749302:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:3.0:1788612510.318827:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612511.343466:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612512.366295:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788612512.429078:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788612513.388053:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612513.836250:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612513.836274:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914365184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612513.836356:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612513.836552:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914365184 00000100:00100000:3.0:1788612513.836564:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914365184 00000100:00100000:3.0:1788612513.836655:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788612513.836669:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914365184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612513.836746:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612513.836805:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914365184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612513.836813:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788612513.836882:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ebfc4ce00 x1875495914365184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612513.836901:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914365184:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788612513.837092:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612514.348289:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914365568:0@lo:400:kworker.0 00000100:00100000:3.0:1788612514.348362:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612514.348427:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788612514.348433:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914365440:0@lo:400:kworker.0 00000100:00100000:3.0:1788612514.348459:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612514.348476:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914365952:0@lo:400:kworker.0 00000100:00100000:3.0:1788612514.348500:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612514.348533:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914365568 00000100:00100000:3.0:1788612514.348541:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914365568 00000100:00100000:3.0:1788612514.348589:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914365440 00000100:00100000:3.0:1788612514.348593:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914365440 00000100:00100000:3.0:1788612514.348650:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788612514.348659:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875495914365568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612514.348711:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875495914365568:12345-0@lo:400:kworker.0 Request processed in 53us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612514.348718:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788612514.348749:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788612514.348757:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914365440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612514.348804:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914365440:12345-0@lo:400:kworker.0 Request processed in 48us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612514.348810:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788612514.348829:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914365952 00000100:00100000:3.0:1788612514.348833:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914365952 00000100:00100000:3.0:1788612514.348879:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788612514.348887:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914365952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612514.348916:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914365952:12345-0@lo:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612514.348937:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788612514.348977:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914365440:0@lo:400:kworker.0 00000100:00100000:3.0:1788612514.348988:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914365952:0@lo:400:kworker.0 00000100:00100000:3.0:1788612514.348996:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914365568:0@lo:400:kworker.0 00000100:00080000:1.0:1788612514.349393:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612514.349399:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612514.349411:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914365312:0@lo:400:kworker.0 00000100:00100000:1.0:1788612514.349450:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612514.349487:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914365824:0@lo:400:kworker.0 00000100:00100000:1.0:1788612514.349510:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612514.349534:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612514.349540:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914365696:0@lo:400:kworker.0 00000100:00100000:1.0:1788612514.349570:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612514.349596:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914365696 00000100:00100000:1.0:1788612514.349612:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914365696 00000100:00100000:1.0:1788612514.349638:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788612514.349644:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914365696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612514.349680:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914365696:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612514.349686:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788612514.349716:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ea7bc8a80 x1875495914365696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612514.349727:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914365696:0@lo:400:kworker.0 00000100:00100000:0.0:1788612514.349866:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914365312 00000100:00100000:0.0:1788612514.349871:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914365312 00000100:00100000:0.0:1788612514.349909:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788612514.349916:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3308:x1875495914365312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612514.349950:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3308:x1875495914365312:12345-0@lo:400:kworker.0 Request processed in 35us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612514.349956:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788612514.350270:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914365824 00000100:00100000:3.0:1788612514.350275:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914365824 00000100:00100000:3.0:1788612514.350319:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788612514.350326:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914365824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612514.350360:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914365824:12345-0@lo:400:kworker.0 Request processed in 35us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612514.350367:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1788612514.350435:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612514.350499:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914365312:0@lo:400:kworker.0 00000100:00100000:1.0:1788612514.350509:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914365824:0@lo:400:kworker.0 00010000:00010000:3.0:1788612514.412484:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612514.748564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612514.748638:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612514.749660:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893360256 00000100:00100000:3.0:1788612514.749672:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893360256 00000100:00100000:3.0:1788612514.749739:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 279 00000100:00100000:3.0:1788612514.749750:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2353:x1875495893360256:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612514.749869:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2353:x1875495893360256:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 90us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612514.749876:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 279 00000100:00100000:1.0:1788612514.749967:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893360384 00000100:00100000:1.0:1788612514.749972:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893360384 00000100:00100000:1.0:1788612514.750024:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:1.0:1788612514.750032:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2353:x1875495893360384:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612514.750065:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2353:x1875495893360384:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 34us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612514.750071:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00080000:3.0:1788612514.751438:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612514.759053:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612514.759912:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893360640 00000100:00100000:3.0:1788612514.759925:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893360640 00000100:00100000:3.0:1788612514.760032:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:3.0:1788612514.760045:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2354:x1875495893360640:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612514.760055:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612514.760133:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2354:x1875495893360640:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 91us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612514.760141:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:3.0:1788612514.760165:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893360512 00000100:00100000:3.0:1788612514.760169:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893360512 00000100:00100000:3.0:1788612514.760201:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:3.0:1788612514.760214:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2352:x1875495893360512:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:3.0:1788612514.760235:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af418d5 00000100:00080000:3.0:1788612514.760244:0:6695:0:(import.c:65:import_set_state_nolock()) ffff928d8507a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788612514.760282:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1788612514.760683:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788612514.760750:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612514.760756:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612514.760917:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+2:2352:x1875495893360512:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 707us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612514.760926:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:3.0:1788612514.866662:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612514.866688:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914366080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612514.866759:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612514.866862:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914366080 00000100:00100000:3.0:1788612514.866870:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914366080 00000100:00100000:3.0:1788612514.866959:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788612514.866970:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914366080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612514.867013:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612514.867063:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914366080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612514.867071:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788612514.867119:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914366080:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788612514.990070:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000020:00000080:2.0:1788612514.990094:0:7644:0:(genops.c:885:class_export_put()) final put ffff928d8507d800/f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000020:00000080:3.0:1788612514.990171:0:497:0:(genops.c:844:class_export_destroy()) destroying export ffff928d8507d800/f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab for lustre-OST0001 00000020:00000080:3.0:1788612514.990585:0:497:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928d8507a000 for lustre-OST0001 00010000:00010000:3.0:1788612515.436304:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612516.460475:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612517.484880:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612518.508528:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612518.956391:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914366208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612518.956469:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612518.956559:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914366208 00000100:00100000:3.0:1788612518.956566:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914366208 00000100:00100000:3.0:1788612518.956622:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788612518.956629:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914366208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612518.956657:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788612518.956867:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612518.958819:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914366208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2178us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612518.958834:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788612518.959088:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ebfc4df80 x1875495914366208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612518.959113:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914366208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612519.468572:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914366592:0@lo:400:kworker.0 00000100:00100000:3.0:1788612519.468644:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612519.468729:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788612519.468736:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914366464:0@lo:400:kworker.0 00000100:00100000:3.0:1788612519.468762:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612519.468781:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914366976:0@lo:400:kworker.0 00000100:00100000:3.0:1788612519.468804:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612519.468875:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914366592 00000100:00100000:3.0:1788612519.468882:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914366592 00000100:00100000:3.0:1788612519.468931:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914366464 00000100:00100000:3.0:1788612519.468935:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914366464 00000100:00100000:3.0:1788612519.468958:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788612519.468967:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875495914366592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612519.469017:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875495914366592:12345-0@lo:400:kworker.0 Request processed in 52us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612519.469024:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788612519.469041:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788612519.469047:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914366464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612519.469074:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914366464:12345-0@lo:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612519.469080:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788612519.469101:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914366976 00000100:00100000:3.0:1788612519.469105:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914366976 00000100:00100000:3.0:1788612519.469132:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788612519.469140:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914366976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612519.469169:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914366976:12345-0@lo:400:kworker.0 Request processed in 31us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612519.469175:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788612519.469196:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788612519.469201:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612519.469228:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914366464:0@lo:400:kworker.0 00000100:00100000:3.0:1788612519.469238:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914366976:0@lo:400:kworker.0 00000100:00100000:3.0:1788612519.469246:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914366592:0@lo:400:kworker.0 00000100:00100000:2.0:1788612519.471768:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914366720:0@lo:400:kworker.0 00000100:00100000:2.0:1788612519.471864:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612519.471938:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788612519.471945:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914366336:0@lo:400:kworker.0 00000100:00100000:2.0:1788612519.471975:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612519.472009:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875495914366848:0@lo:400:kworker.0 00000100:00100000:2.0:1788612519.472034:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612519.472068:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914366848 00000100:00100000:2.0:1788612519.472086:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914366848 00000100:00100000:2.0:1788612519.472139:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788612519.472148:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875495914366848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612519.472202:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875495914366848:12345-0@lo:400:kworker.0 Request processed in 54us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612519.472209:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1788612519.472233:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612519.472262:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875495914366848:0@lo:400:kworker.0 00000100:00100000:1.0:1788612519.472358:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914366720 00000100:00100000:1.0:1788612519.472363:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914366720 00000100:00100000:1.0:1788612519.472414:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788612519.472421:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914366720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612519.472465:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914366720:12345-0@lo:400:kworker.0 Request processed in 44us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612519.472471:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788612519.472498:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ea7bc9880 x1875495914366720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612519.472510:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914366720:0@lo:400:kworker.0 00000100:00100000:3.0:1788612519.473724:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914366336 00000100:00100000:3.0:1788612519.473736:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914366336 00000100:00100000:3.0:1788612519.473794:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788612519.473803:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3307:x1875495914366336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612519.473900:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3307:x1875495914366336:12345-0@lo:400:kworker.0 Request processed in 98us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612519.473907:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788612519.474961:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914366336:0@lo:400:kworker.0 00010000:00010000:3.0:1788612519.532068:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612519.868519:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612519.868583:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612519.868628:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612519.868777:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893360768 00000100:00100000:2.0:1788612519.868788:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893360768 00000100:00100000:2.0:1788612519.868919:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 281 00000100:00100000:1.0:1788612519.868934:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893360896 00000100:00100000:1.0:1788612519.868940:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893360896 00000100:00100000:2.0:1788612519.868948:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2353:x1875495893360768:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612519.868988:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893361024 00000100:00100000:1.0:1788612519.868991:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893361024 00000100:00100000:1.0:1788612519.869015:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:2.0:1788612519.869026:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2353:x1875495893360768:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 79us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612519.869027:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2353:x1875495893360896:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612519.869039:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 281 00000100:00100000:1.0:1788612519.869067:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2353:x1875495893360896:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 44us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612519.869076:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:1.0:1788612519.869089:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:1.0:1788612519.869095:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893361024:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612519.869113:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893361024:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 18us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612519.869118:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00080000:1.0:1788612519.869142:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612519.981908:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914367104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612519.981982:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612519.983186:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914367104 00000100:00100000:2.0:1788612519.983199:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914367104 00000100:00100000:2.0:1788612519.983264:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788612519.983274:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914367104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612519.983321:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612519.983388:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914367104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612519.983395:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788612519.983449:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914367104:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788612520.556024:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612521.582637:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612522.603996:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788612522.672564:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788612523.634984:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612524.078327:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612524.078351:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914367232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612524.078432:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612524.078504:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914367232 00000100:00100000:0.0:1788612524.078511:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914367232 00000100:00100000:0.0:1788612524.078569:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788612524.078578:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914367232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788612524.078615:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612524.078656:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914367232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612524.078663:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788612524.078682:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788612524.078708:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ebfc4f100 x1875495914367232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612524.078726:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914367232:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788612524.141306:0:11854:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:48:42 (1788612522) 00000100:00100000:3.0:1788612524.588119:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914367616:0@lo:400:kworker.0 00000100:00100000:3.0:1788612524.588213:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612524.588281:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788612524.588288:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914367488:0@lo:400:kworker.0 00000100:00100000:3.0:1788612524.588313:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612524.588333:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914368000:0@lo:400:kworker.0 00000100:00100000:3.0:1788612524.588356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612524.588488:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914367360:0@lo:400:kworker.0 00000100:00100000:0.0:1788612524.588532:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612524.588556:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914367872:0@lo:400:kworker.0 00000100:00100000:0.0:1788612524.588578:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612524.588595:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612524.588613:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914367744:0@lo:400:kworker.0 00000100:00100000:0.0:1788612524.588637:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612524.588723:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914367616 00000100:00100000:1.0:1788612524.588737:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914367616 00000100:00100000:2.0:1788612524.588865:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914367360 00000100:00100000:2.0:1788612524.588870:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914367360 00000100:00100000:2.0:1788612524.588904:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788612524.588913:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3308:x1875495914367360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612524.588971:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3308:x1875495914367360:12345-0@lo:400:kworker.0 Request processed in 60us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612524.588978:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788612524.595589:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914367360:0@lo:400:kworker.0 00000100:00080000:0.0:1788612524.595717:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612524.595969:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914367488 00000100:00100000:1.0:1788612524.595977:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914367488 00000100:00100000:0.0:1788612524.605350:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914367872 00000100:00100000:0.0:1788612524.605368:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914367872 00000100:00100000:0.0:1788612524.605463:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788612524.605475:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875495914367616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612524.605578:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875495914367616:12345-0@lo:400:kworker.0 Request processed in 105us (17365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612524.605585:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788612524.605723:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788612524.605732:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914367488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612524.605765:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914367488:12345-0@lo:400:kworker.0 Request processed in 35us (17451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612524.605770:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788612524.605795:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788612524.605801:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914367872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612524.605835:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914367872:12345-0@lo:400:kworker.0 Request processed in 33us (17255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612524.605858:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1788612524.605892:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612524.605929:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914367872:0@lo:400:kworker.0 00000100:00100000:0.0:1788612524.605989:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914368000 00000100:00100000:0.0:1788612524.605993:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914368000 00000100:00100000:0.0:1788612524.606028:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914367744 00000100:00100000:0.0:1788612524.606031:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914367744 00000100:00100000:0.0:1788612524.606055:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788612524.606062:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914368000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612524.606096:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914368000:12345-0@lo:400:kworker.0 Request processed in 35us (17739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612524.606103:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788612524.606113:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788612524.606119:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914367744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612524.606151:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914367744:12345-0@lo:400:kworker.0 Request processed in 32us (17514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612524.606157:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788612524.606176:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788612524.606195:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928ea7bca680 x1875495914367744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612524.606207:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914367744:0@lo:400:kworker.0 00000100:00100000:1.0:1788612524.607585:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914367488:0@lo:400:kworker.0 00000100:00100000:1.0:1788612524.608486:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914368000:0@lo:400:kworker.0 00000100:00100000:1.0:1788612524.608514:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914367616:0@lo:400:kworker.0 00010000:00010000:0.0:1788612524.652943:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612524.991520:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612524.993991:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893361152 00000100:00100000:0.0:1788612524.994007:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893361152 00000100:00100000:0.0:1788612524.994090:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 283 00000100:00100000:0.0:1788612524.994101:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893361152:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612524.994201:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893361152:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 102us (2691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612524.994224:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 283 00000100:00100000:2.0:1788612524.997445:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612524.999762:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893361280 00000100:00100000:0.0:1788612524.999779:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893361280 00000100:00100000:0.0:1788612524.999932:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:0.0:1788612525.000028:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2356:x1875495893361280:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612525.000183:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2356:x1875495893361280:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 241us (2748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612525.000212:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:3.0:1788612525.000444:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612525.000461:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893361408 00000100:00100000:1.0:1788612525.000466:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893361408 00000100:00080000:2.0:1788612525.000595:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612525.000636:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:1.0:1788612525.000647:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893361408:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612525.000701:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893361408:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 56us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612525.009900:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:0.0:1788612525.100751:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612525.100776:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914368128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612525.100902:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612525.100967:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914368128 00000100:00100000:0.0:1788612525.100975:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914368128 00000100:00100000:0.0:1788612525.101027:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788612525.101037:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914368128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612525.101075:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612525.101139:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914368128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612525.101146:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788612525.101167:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914368128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788612525.677827:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612525.780523:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612525.780633:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893361536 00000100:00100000:0.0:1788612525.780644:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893361536 00000100:00100000:0.0:1788612525.780709:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:0.0:1788612525.780719:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:10220:x1875495893361536:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612525.780740:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612525.780764:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af419a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd8aa expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.780964:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af419a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.780980:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af419a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.780994:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af419a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612525.781031:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788612525.781035:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612525.781075:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af419a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.781101:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af419a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8aa expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.781119:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af419a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8aa expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.781127:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e91fbbe00) 00010000:00010000:0.0:1788612525.781130:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612525.781204:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf600, rc 0) 00000100:00100000:0.0:1788612525.781271:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:10220:x1875495893361536:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 553us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612525.781279:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:0.0:1788612525.787489:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612525.787882:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893361664 00000100:00100000:3.0:1788612525.787897:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893361664 00000100:00100000:3.0:1788612525.787951:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:3.0:1788612525.787962:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:10221:x1875495893361664:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612525.787999:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612525.788022:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af419ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd8b1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788084:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788099:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788111:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788125:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788143:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788151:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788373:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077000/0xfc956d548af419c3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788382:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077000/0xfc956d548af419c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788390:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077000/0xfc956d548af419c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612525.788418:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788612525.788428:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612525.788454:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077000/0xfc956d548af419c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788464:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788470:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788476:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788480:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612525.788484:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788491:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788502:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e91fbbe00) 00010000:00010000:3.0:1788612525.788506:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612525.788510:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788518:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788531:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788537:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788553:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788559:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0076800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612525.788562:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788569:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788578:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff928ea7bbc900) 00010000:00010000:3.0:1788612525.788580:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612525.788584:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788590:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788635:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af419ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8b1 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788649:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077000/0xfc956d548af419c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8b1 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612525.788657:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff928ea7bbcc00) 00010000:00010000:3.0:1788612525.788659:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612525.788661:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077000, rc 0) 00000100:00100000:3.0:1788612525.788727:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:10221:x1875495893361664:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 768us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612525.788738:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:2.0:1788612525.805043:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612525.805160:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893361920 00000100:00100000:0.0:1788612525.805177:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893361920 00000100:00100000:0.0:1788612525.805237:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:0.0:1788612525.805247:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:10221:x1875495893361920:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612525.805266:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612525.805285:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af419ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd8b8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.805354:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af419d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.805368:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af419d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.805380:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af419d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.805444:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af419d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.805452:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af419d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.805459:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af419d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.805827:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af419df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.806033:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af419df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612525.806044:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af419df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612525.806060:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788612525.806280:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af419d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.806288:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af419d1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.806295:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af419d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.806301:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdee00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612525.806305:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af419d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.806313:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af419d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.806332:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff928ea7bbcc00) 00010000:00010000:1.0:1788612525.806335:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612525.806340:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af419d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.806347:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af419d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.806360:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af419d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.806367:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af419d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.806373:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af419d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.806379:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612525.806381:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af419d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.806386:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af419d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.806405:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff928e91fbb500) 00010000:00010000:1.0:1788612525.806407:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612525.806410:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af419d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.806416:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af419d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.806990:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af419ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8b8 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.807008:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af419df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8b8 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612525.807016:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb600) 00010000:00010000:1.0:1788612525.807018:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612525.807021:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf200, rc 0) 00000100:00100000:1.0:1788612525.807089:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:10221:x1875495893361920:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1843us (2055us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788612525.807098:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:2.0:1788612525.810692:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612525.810761:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893362048 00000100:00100000:3.0:1788612525.810771:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893362048 00000100:00100000:3.0:1788612525.810870:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:3.0:1788612525.810881:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:10221:x1875495893362048:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788612525.810989:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:10221:x1875495893362048:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 Request processed in 109us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612525.810996:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00010000:00010000:0.0:1788612526.701047:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788612526.764808:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788612527.724995:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612527.729648:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612527.730224:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893362176 00000100:00100000:3.0:1788612527.730235:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893362176 00000100:00100000:3.0:1788612527.731309:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:3.0:1788612527.731322:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:10263:x1875495893362176:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612527.731343:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612527.731364:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af419ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd8bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731427:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731442:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731454:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731468:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731486:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731494:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731763:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731772:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731779:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731785:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0076800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612527.731789:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731797:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731823:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e91fbbe00) 00010000:00010000:3.0:1788612527.731826:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612527.731832:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731862:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af419f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731874:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731886:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731893:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731898:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612527.731901:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731908:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731917:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff928ea7bbcb00) 00010000:00010000:3.0:1788612527.731919:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612527.731922:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731929:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af419fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731961:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af419ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8bf expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731971:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e91fbbe00) 00010000:00010000:3.0:1788612527.731973:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612527.731978:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af419ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8bf expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.731986:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077400, rc 0) 00000100:00100000:3.0:1788612527.732060:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:10263:x1875495893362176:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 741us (2426us total) trans 0 rc 301/301 00000100:00100000:3.0:1788612527.732068:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00080000:1.0:1788612527.734672:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612527.744263:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612527.744341:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893362432 00000100:00100000:3.0:1788612527.744350:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893362432 00000100:00100000:3.0:1788612527.744428:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:3.0:1788612527.744439:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:10263:x1875495893362432:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:3.0:1788612527.744514:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612527.744540:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af419a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8aa expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.744558:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e91fbbe00) 00010000:00010000:3.0:1788612527.744568:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612527.745011:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41a02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.745025:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41a02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.745036:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41a02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.745047:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41a09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.745054:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41a09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.745059:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41a09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612527.746315:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788612527.746329:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41a02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.746337:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41a02 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.746343:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41a02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.746349:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612527.746353:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41a02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.746361:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41a02 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.746373:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928ea7bbc000) 00010000:00010000:3.0:1788612527.746376:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612527.746380:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41a02 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.746385:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41a02 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612527.750046:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e7bd273 reply state 00000000706b38d2 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41a09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612527.750068:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788612527.750216:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+10:10263:x1875495893362432:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 5773us (5958us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788612527.750243:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00010000:00010000:0.0:1788612527.758148:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41a09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612527.758167:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41a09 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612527.758175:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41a09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612527.758181:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0076000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612527.758186:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41a09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612527.758194:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41a09 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612527.758210:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff928ea7bbc300) 00010000:00010000:0.0:1788612527.758214:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612527.758219:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41a09 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612527.758225:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41a09 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612527.856698:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612527.856882:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893362560 00000100:00100000:3.0:1788612527.856893:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893362560 00000100:00100000:3.0:1788612527.856956:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:3.0:1788612527.856968:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:10271:x1875495893362560:12345-192.168.202.6@tcp:101:lctl.0 00010000:00010000:3.0:1788612527.856993:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612527.857017:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41a10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd8c6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.857085:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af41a17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.857099:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af41a17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.857112:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af41a17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612527.857159:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788612527.857163:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612527.857205:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af41a17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.857229:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41a10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8c6 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.857245:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af41a17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8c6 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.857272:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928ea7bbc000) 00010000:00010000:3.0:1788612527.857275:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612527.857279:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077400, rc 0) 00000100:00100000:3.0:1788612527.857336:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+10:10271:x1875495893362560:12345-192.168.202.6@tcp:101:lctl.0 Request processed in 371us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612527.857343:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:3.0:1788612527.897584:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612527.898223:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893362688 00000100:00100000:3.0:1788612527.898236:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893362688 00000100:00100000:3.0:1788612527.898292:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:3.0:1788612527.898302:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+10:10277:x1875495893362688:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1788612527.898324:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612527.898345:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41a1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd8cd expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898415:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41a25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898429:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41a25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898442:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41a25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898454:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41a2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898461:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41a2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898474:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41a2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898566:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af41a33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898574:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af41a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898582:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af41a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612527.898609:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788612527.898612:0:8316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612527.898724:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af41a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898736:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41a25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898901:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41a25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898910:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41a25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898915:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612527.898920:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41a25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898928:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41a25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898944:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928ea7bbc000) 00010000:00010000:3.0:1788612527.898947:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612527.898952:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41a25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898958:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41a25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898970:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41a2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898977:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41a2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898983:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41a2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898987:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0076800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612527.898990:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41a2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.898996:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41a2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.899004:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff928ea7bbcb00) 00010000:00010000:3.0:1788612527.899006:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612527.899009:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41a2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.899015:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41a2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.899058:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41a1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8cd expref: 12 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.899072:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af41a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8cd expref: 11 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.899080:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:3.0:1788612527.899082:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788612527.899084:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077600, rc 0) 00000100:00100000:3.0:1788612527.899146:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:10277:x1875495893362688:12345-192.168.202.6@tcp:101:bash.0 Request processed in 845us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612527.899154:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:3.0:1788612527.904227:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612527.904264:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893362944 00000100:00100000:3.0:1788612527.904274:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893362944 00000100:00100000:3.0:1788612527.904370:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:3.0:1788612527.904380:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:10277:x1875495893362944:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1788612527.904401:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612527.904422:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41a3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd8d4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.904538:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.904552:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.904577:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.904607:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af41a48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.904615:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af41a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.904622:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af41a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788612527.908094:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788612527.908287:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af41a4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.908305:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af41a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.908318:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af41a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.908356:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.908363:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.908371:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.908376:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612527.908387:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.908395:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.908408:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:3.0:1788612527.908411:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612527.908415:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.908422:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612527.908434:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fcce72d reply state 000000009f7280e2 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af41a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612527.908443:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788612527.908476:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41a3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8d4 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.908491:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af41a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8d4 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612527.908499:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbc400) 00010000:00010000:3.0:1788612527.908501:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612527.908504:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030200, rc 0) 00000100:00100000:3.0:1788612527.908576:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:10277:x1875495893362944:12345-192.168.202.6@tcp:101:bash.0 Request processed in 4198us (4359us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788612527.908584:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 40 00010000:00010000:2.0:1788612527.913799:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af41a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612527.913825:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af41a48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612527.913833:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af41a48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612527.913855:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612527.913860:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af41a48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612527.913868:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af41a48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612527.913885:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928ea7bbca00) 00010000:00010000:2.0:1788612527.913888:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612527.913893:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af41a48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612527.913899:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af41a48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612527.922903:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612527.922936:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893363072 00000100:00100000:0.0:1788612527.922944:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893363072 00000100:00100000:0.0:1788612527.922983:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:0.0:1788612527.922991:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875495893363072:12345-192.168.202.6@tcp:8:bash.0 00010000:00080000:0.0:1788612527.923020:0:8463:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:0.0:1788612527.923045:0:8463:0:(genops.c:1385:class_connect()) connect: client f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab, cookie 0xfc956d548af41a5d 00002000:00100000:0.0:1788612527.923056:0:8463:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab/ffff928d8524f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788612527.923078:0:8463:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788612527.923283:0:8463:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788612527.923310:0:8463:0:(import.c:65:import_set_state_nolock()) ffff928d8507f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612527.923367:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2352:x1875495893363072:12345-192.168.202.6@tcp:8:bash.0 Request processed in 375us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612527.923374:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:0.0:1788612527.926485:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612527.926612:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893363200 00000100:00100000:2.0:1788612527.927357:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893363200 00000100:00100000:2.0:1788612527.927503:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:2.0:1788612527.927515:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:0:x1875495893363200:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1788612527.927613:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612527.931180:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41a64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd8db expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612527.931221:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612527.931243:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=321s v=(0 0) 00010000:00010000:2.0:1788612527.931248:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612527.931261:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41a64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8db expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612527.931286:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41a64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8db expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612527.931300:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8200, rc 0) 00000100:00100000:2.0:1788612527.931387:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:0:x1875495893363200:12345-192.168.202.6@tcp:101:bash.0 Request processed in 3873us (4911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612527.931397:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00080000:0.0:1788612527.932921:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612527.953233:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612527.953334:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893363328 00000100:00100000:0.0:1788612527.953344:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893363328 00000100:00100000:0.0:1788612527.953464:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:0.0:1788612527.953476:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:10277:x1875495893363328:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1788612527.953496:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612527.953518:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd8e2 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612527.953559:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41a64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8db expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612527.953568:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612527.953572:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612527.953589:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612527.953751:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41a64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8db expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612527.953770:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41a64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8db expref: 8 pid: 6698 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612527.953785:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1875495914368256:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612527.953969:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612527.962046:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1875495914368256:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612527.962086:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612527.962112:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdfa00, rc 0) 00000100:00100000:3.0:1788612527.962167:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612527.962184:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:10277:x1875495893363328:12345-192.168.202.6@tcp:101:bash.0 Request processed in 8709us (8960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612527.962194:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:2.0:1788612527.962375:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893363456 00000100:00100000:2.0:1788612527.962382:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893363456 00010000:00010000:2.0:1788612527.962419:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41a64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8db expref: 8 pid: 6698 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612527.962458:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:2.0:1788612527.962468:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2356:x1875495893363456:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612527.962481:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612527.962502:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41a64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8db expref: 8 pid: 6698 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612527.962541:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41a64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8db expref: 8 pid: 6698 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612527.962566:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41a64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8db expref: 8 pid: 6698 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612527.962579:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612527.962583:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612527.962592:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612527.962602:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612527.962872:0:11669:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612527.962888:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0748a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11669:1875495914368384:192.168.202.6@tcp:105: 00000100:00100000:2.0:1788612527.962954:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612527.966063:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612527.966150:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0748a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11669:1875495914368384:192.168.202.6@tcp:105: 00010000:00010000:2.0:1788612527.966175:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612527.966233:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2356:x1875495893363456:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 3766us (4067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612527.966243:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:0.0:1788612527.966328:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893363712 00000100:00100000:0.0:1788612527.966334:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893363712 00000100:00100000:0.0:1788612527.966381:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:0.0:1788612527.966390:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:10277:x1875495893363712:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:0.0:1788612527.966996:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:10277:x1875495893363712:12345-192.168.202.6@tcp:35:bash.0 Request processed in 604us (941us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788612527.967003:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:3.0:1788612528.049352:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612528.049637:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893363968 00000100:00100000:2.0:1788612528.049648:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893363968 00000100:00100000:2.0:1788612528.049794:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:2.0:1788612528.049806:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:10287:x1875495893363968:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612528.049894:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612528.049917:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41a72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd8e9 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612528.049999:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788612528.050115:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41a72 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e9 expref: 16 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.050129:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928ea7bbc000) 00010000:00010000:2.0:1788612528.050132:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612528.050137:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41a72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e9 expref: 16 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.050150:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8200, rc 0) 00000100:00100000:2.0:1788612528.050210:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:10287:x1875495893363968:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 406us (869us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788612528.050216:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:3.0:1788612528.053217:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612528.053292:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893364224 00000100:00100000:0.0:1788612528.053299:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893364224 00000100:00100000:0.0:1788612528.053356:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:0.0:1788612528.053367:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:10287:x1875495893364224:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1788612528.053596:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:10287:x1875495893364224:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 229us (385us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788612528.053604:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:0.0:1788612528.129447:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612528.129645:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893364352 00000100:00100000:3.0:1788612528.129655:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893364352 00000100:00100000:3.0:1788612528.129723:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:3.0:1788612528.129733:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:10293:x1875495893364352:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612528.129755:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612528.129777:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af41a80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd8f0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.129886:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.129900:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.129911:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612528.129942:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788612528.129945:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612528.129963:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.129990:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af41a80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8f0 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.130023:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8f0 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.130031:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:3.0:1788612528.130033:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612528.130037:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030000, rc 0) 00000100:00100000:3.0:1788612528.130105:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:10293:x1875495893364352:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 373us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612528.130112:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:3.0:1788612528.134500:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612528.134673:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893364608 00000100:00100000:0.0:1788612528.134685:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893364608 00000100:00100000:0.0:1788612528.134752:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:0.0:1788612528.134763:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:10293:x1875495893364608:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1788612528.134785:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612528.134809:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41a8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd8f7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.134972:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41a95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.134988:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.135000:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612528.135011:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788612528.135152:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41a8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8f7 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.135169:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41a95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8f7 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.135178:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbc400) 00010000:00010000:0.0:1788612528.135181:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612528.135185:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdfc00, rc 0) 00000100:00100000:0.0:1788612528.135242:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:10293:x1875495893364608:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 481us (754us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788612528.135265:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:1.0:1788612528.140523:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612528.140705:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612528.140878:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893364992 00000100:00100000:3.0:1788612528.140889:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893364992 00000100:00100000:3.0:1788612528.140963:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:3.0:1788612528.140974:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:10293:x1875495893364992:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612528.140996:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612528.141017:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af41aa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd8fe expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.141114:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af41aaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.141129:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af41aaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.141141:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af41aaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612528.141350:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788612528.141468:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af41aa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8fe expref: 22 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.141485:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af41aaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8fe expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.141493:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbc400) 00010000:00010000:3.0:1788612528.141495:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788612528.141498:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030600, rc 0) 00000100:00100000:3.0:1788612528.141687:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:10293:x1875495893364992:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 715us (981us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788612528.141692:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:2.0:1788612528.142604:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893364736 00000100:00100000:2.0:1788612528.142614:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893364736 00000100:00100000:2.0:1788612528.142738:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:2.0:1788612528.142749:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:2353:x1875495893364736:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612528.142762:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612528.142780:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41a95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8f7 expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.142807:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbc400) 00010000:00010000:2.0:1788612528.142824:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612528.143004:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:2353:x1875495893364736:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 256us (2498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612528.143012:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:3.0:1788612528.146704:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612528.146830:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893365120 00000100:00100000:2.0:1788612528.146863:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893365120 00000100:00100000:2.0:1788612528.146917:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:2.0:1788612528.146927:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2356:x1875495893365120:12345-192.168.202.6@tcp:1:lfs.0 00010000:00010000:2.0:1788612528.146970:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41ab8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.146990:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.146998:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612528.147003:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788612528.147007:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41ab8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.147046:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.147061:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 7 pid: 8463 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612528.147098:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0748a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875495914368512:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612528.147193:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612528.152337:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0748a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875495914368512:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612528.152370:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41ab8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612528.153001:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612528.153245:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893365248 00000100:00100000:2.0:1788612528.153254:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893365248 00002000:00100000:2.0:1788612528.153299:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff928e90c54700 x1875495893365248/t0(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:174/0 lens 504/0 e 0 to 0 dl 1788612539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788612528.153310:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928e90c54700 with x1875495893365248 ext(0->12) 00010000:00010000:2.0:1788612528.153319:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 8 pid: 8463 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.153335:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 8 pid: 8463 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612528.153343:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff928e90c54700 00000100:00100000:2.0:1788612528.153375:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:2.0:1788612528.153385:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2356:x1875495893365248:12345-192.168.202.6@tcp:4:lfs.0 00000001:00100000:2.0:1788612528.192398:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000100:00100000:1.0:1788612528.195644:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2356:x1875495893365248:12345-192.168.202.6@tcp:4:lfs.0 Request processed in 42251us (42637us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788612528.195662:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00002000:00100000:1.0:1788612528.195684:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff928e90c54700 x1875495893365248/t4294967299(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:174/0 lens 504/448 e 0 to 0 dl 1788612539 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788612528.195695:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928e90c54700 with x1875495893365248 ext(0->12) 00010000:00010000:1.0:1788612528.195706:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 9 pid: 8463 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.195722:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 9 pid: 8463 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788612528.195729:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff928e90c54700 00000100:00100000:3.0:1788612528.198032:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612528.201289:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893365376 00000100:00100000:0.0:1788612528.201304:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893365376 00010000:00010000:0.0:1788612528.201353:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 9 pid: 8463 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612528.201459:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:0.0:1788612528.201468:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2353:x1875495893365376:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612528.201480:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788612528.201496:0:5838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788612528.201498:0:5838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788612528 00002000:00010000:0.0:1788612528.201500:0:5838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788612528 00002000:00010000:0.0:1788612528.201501:0:5838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788612528 00010000:00010000:0.0:1788612528.201505:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 9 pid: 8463 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.201516:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 9 pid: 8463 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.201917:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a26fae49/0xfc956d548af41a6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8e2 expref: 9 pid: 8463 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.202217:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788612528.202221:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612528.202226:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41ab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.202270:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41ab8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.202309:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612528.202369:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2353:x1875495893365376:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 901us (4348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612528.202377:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00010000:00010000:1.0:1788612528.202392:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41ab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.202412:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41ab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.202441:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41ab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.202449:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41ab8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.202456:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41ab8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.202468:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612528.202472:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41ab8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.202481:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41ab8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.202493:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41ab8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.202501:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41ab8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612528.202552:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2356:x1875495893365120:12345-192.168.202.6@tcp:1:lfs.0 Request processed in 55626us (55858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612528.202560:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:3.0:1788612528.209950:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612528.210164:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893365632 00000100:00100000:0.0:1788612528.210175:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893365632 00000100:00100000:0.0:1788612528.210236:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:0.0:1788612528.210247:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:10293:x1875495893365632:12345-192.168.202.6@tcp:35:lfs.0 00000004:00010000:0.0:1788612528.210315:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af41aaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8fe expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612528.211031:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788612528.211092:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788612528.212020:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788612528.212221:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.212243:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af41a4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8d4 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.212252:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.212292:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af41a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8d4 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.212318:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af41a4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8d4 expref: 24 pid: 5852 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612528.212334:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1875495914368640:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612528.212893:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612528.216129:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612528.216274:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893365760 00000100:00100000:3.0:1788612528.216285:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893365760 00010000:00010000:3.0:1788612528.216326:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af41a4f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8d4 expref: 25 pid: 5852 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612528.216367:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:3.0:1788612528.216379:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+25:2355:x1875495893365760:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612528.216393:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612528.216400:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af41a4f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8d4 expref: 25 pid: 5852 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.216435:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af41a4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8d4 expref: 25 pid: 5852 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.216456:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbc400) 00010000:00010000:3.0:1788612528.216461:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.216471:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.216478:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.216499:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612528.216567:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+25:2355:x1875495893365760:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 190us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612528.216574:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00010000:00010000:0.0:1788612528.216931:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af41a4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8d4 expref: 24 pid: 5852 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612528.216949:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1875495914368640:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612528.216971:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.216980:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.216986:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612528.217111:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788612528.217316:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788612528.217434:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875495914368768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788612528.217478:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612528.217511:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc300 going to sleep for 11 seconds 00000100:00100000:3.0:1788612528.218067:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914368768 00000100:00100000:3.0:1788612528.218075:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914368768 00000100:00080000:0.0:1788612528.218220:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612528.218355:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612528.218366:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875495914368768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788612528.218462:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875495914368768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 99us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612528.218468:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612528.219978:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875495914368768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788612528.221305:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788612528.221466:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875495914368896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788612528.221635:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612528.225377:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612528.228288:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914368896 00000100:00100000:1.0:1788612528.228303:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914368896 00000100:00100000:1.0:1788612528.228369:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612528.228378:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5855:x1875495914368896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788612528.228944:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5855:x1875495914368896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 564us (7412us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788612528.228953:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612528.229080:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875495914368896:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788612528.229263:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788612528.229309:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.229320:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.229327:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.229333:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdfc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612528.229337:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.229344:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.229360:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbc400) 00010000:00010000:0.0:1788612528.229363:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788612528.229367:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.229374:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41abf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788612528.229989:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788612528.235859:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788612528.235885:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322079047000ns, next at 323079041937ns, rc = 0 00000001:00080000:2.0:1788612528.235920:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788612528.236000:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbc400) 00010000:00010000:2.0:1788612528.236004:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788612528.236016:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af41aaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8fe expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612528.237140:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+27:10293:x1875495893365632:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 26888us (27195us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788612528.237164:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000020:00080000:2.0:1788612528.237170:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788612528.245522:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612528.247778:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893365888 00000100:00100000:0.0:1788612528.247800:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893365888 00000100:00100000:0.0:1788612528.247890:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:0.0:1788612528.247901:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+27:10293:x1875495893365888:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1788612528.247928:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612528.247952:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ac6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd905 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.248015:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ac6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd905 expref: 28 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.248031:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ac6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd905 expref: 28 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.248052:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:0.0:1788612528.248055:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788612528.248059:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdfc00, rc 0) 00000100:00100000:1.0:1788612528.248269:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+28:10293:x1875495893365888:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 369us (2755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612528.248276:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:3.0:1788612528.254246:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612528.258658:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893366144 00000100:00100000:1.0:1788612528.258771:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893366144 00000100:00100000:1.0:1788612528.259085:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:1.0:1788612528.259097:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e8347ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+28:10293:x1875495893366144:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1788612528.259360:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e8347ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+29:10293:x1875495893366144:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 264us (5123us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788612528.259368:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:3.0:1788612528.396959:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612528.397451:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893366400 00000100:00100000:2.0:1788612528.397461:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893366400 00000100:00100000:2.0:1788612528.397520:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:2.0:1788612528.397531:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+29:10303:x1875495893366400:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612528.397554:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612528.397575:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41acd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd90c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612528.397672:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788612528.397783:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41acd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd90c expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.397797:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928ea7bbc000) 00010000:00010000:2.0:1788612528.397800:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612528.397804:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41acd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd90c expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.397828:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8e00, rc 0) 00000100:00100000:2.0:1788612528.397954:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+30:10303:x1875495893366400:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 425us (1007us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788612528.397961:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:3.0:1788612528.401150:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612528.403038:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893366528 00000100:00100000:2.0:1788612528.403054:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893366528 00000100:00100000:2.0:1788612528.403132:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:2.0:1788612528.403144:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+30:10303:x1875495893366528:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:2.0:1788612528.403237:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41adb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403268:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41adb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403280:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41adb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403298:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41ae2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403304:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403311:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403427:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ae9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403436:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403443:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612528.403498:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403511:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41adb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403517:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41adb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403525:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41adb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403530:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612528.403534:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41adb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403542:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41adb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403555:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:2.0:1788612528.403557:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612528.403561:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41adb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403568:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41adb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403582:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403588:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41ae2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403601:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403606:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612528.403609:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403616:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403625:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e9231d800) 00010000:00010000:2.0:1788612528.403627:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612528.403630:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41ae2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403635:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41ae2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403652:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403668:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403675:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403679:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612528.403682:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403698:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403706:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:2.0:1788612528.403709:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612528.403712:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ae9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.403717:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ae9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612528.403798:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+30:10303:x1875495893366528:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 655us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612528.403806:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:3.0:1788612528.407627:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612528.407889:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893366784 00000100:00100000:2.0:1788612528.407901:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893366784 00000100:00100000:2.0:1788612528.407967:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:2.0:1788612528.407977:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+30:10303:x1875495893366784:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1788612528.408241:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+31:10303:x1875495893366784:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 265us (624us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788612528.408249:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:3.0:1788612528.452338:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612528.459403:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893367040 00000100:00100000:2.0:1788612528.459427:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893367040 00000100:00100000:2.0:1788612528.459512:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:2.0:1788612528.459522:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+31:10306:x1875495893367040:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612528.459546:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612528.459568:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41af0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd913 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.459656:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41af7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460010:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41af7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460023:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41af7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460040:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41afe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460046:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41afe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460052:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41afe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460250:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41b05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460260:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460268:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612528.460279:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788612528.460577:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41af7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460586:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41af7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460602:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41af7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460608:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612528.460613:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41af7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460622:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41af7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460635:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:2.0:1788612528.460639:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612528.460645:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41af7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460652:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41af7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460741:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41afe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460749:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41afe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460754:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41afe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460760:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612528.460764:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41afe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460783:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41afe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460791:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e9231d800) 00010000:00010000:2.0:1788612528.460794:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612528.460798:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41afe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460804:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41afe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.460987:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41af0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd913 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.461003:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd913 expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.461012:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:2.0:1788612528.461015:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612528.461018:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8600, rc 0) 00000100:00100000:2.0:1788612528.461114:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+33:10306:x1875495893367040:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1592us (8797us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788612528.461123:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:3.0:1788612528.463390:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612528.464121:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893367168 00000100:00100000:2.0:1788612528.464133:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893367168 00000100:00100000:2.0:1788612528.464573:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:2.0:1788612528.464586:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+33:10306:x1875495893367168:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:2.0:1788612528.464937:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41b13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.464956:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.464968:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.464996:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.465003:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41b13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.465011:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41b13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.465016:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612528.465021:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41b13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.465029:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41b13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.465041:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:2.0:1788612528.465045:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612528.465049:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41b13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.465057:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41b13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612528.465601:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+33:10306:x1875495893367168:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 1014us (2218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612528.465611:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:3.0:1788612528.468057:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612528.468223:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893367424 00000100:00100000:1.0:1788612528.468234:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893367424 00000100:00100000:1.0:1788612528.468290:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1788612528.468300:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+33:10306:x1875495893367424:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1788612528.468547:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+34:10306:x1875495893367424:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 247us (500us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788612528.468555:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:3.0:1788612528.714576:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612528.714706:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893367680 00000100:00100000:1.0:1788612528.714717:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893367680 00000100:00100000:1.0:1788612528.714984:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:1.0:1788612528.714996:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+34:10337:x1875495893367680:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:1.0:1788612528.715021:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612528.715042:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af41b1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd91a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.715139:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41b21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.715237:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.715250:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612528.715263:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788612528.715430:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af41b1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd91a expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.715449:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41b21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd91a expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.715458:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:1.0:1788612528.715461:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612528.715465:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60e00, rc 0) 00000100:00100000:1.0:1788612528.715582:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+36:10337:x1875495893367680:12345-192.168.202.6@tcp:101:cat.0 Request processed in 589us (1016us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788612528.715590:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:3.0:1788612528.719923:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612528.720010:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612528.720077:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893368064 00000100:00100000:2.0:1788612528.720088:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893368064 00000100:00100000:2.0:1788612528.720170:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:2.0:1788612528.720181:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9238fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+36:2355:x1875495893368064:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612528.720197:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612528.720220:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41b21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd91a expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.720239:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:2.0:1788612528.720244:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612528.721035:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893367936 00000100:00100000:0.0:1788612528.721042:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893367936 00000100:00100000:0.0:1788612528.721079:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:0.0:1788612528.721087:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+36:10337:x1875495893367936:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:2.0:1788612528.721848:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9238fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+37:2355:x1875495893368064:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 1634us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612528.721859:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:0.0:1788612528.722024:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+36:10337:x1875495893367936:12345-192.168.202.6@tcp:35:cat.0 Request processed in 937us (2111us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788612528.722031:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00010000:00010000:0.0:1788612528.748036:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612528.775834:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612528.775978:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893368320 00000100:00100000:1.0:1788612528.775989:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893368320 00000100:00100000:1.0:1788612528.776056:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1788612528.776068:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+36:10343:x1875495893368320:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1788612528.776093:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612528.776096:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788612528.776122:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af41a87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8f0 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.776164:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:1.0:1788612528.776170:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612528.776185:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af41b2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd921 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.776281:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.776296:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41b05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd913 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.776303:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.776330:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd913 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612528.776339:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41b05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd913 expref: 36 pid: 5854 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612528.776348:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c56300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914369024:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612528.776436:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec065b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788612528.781219:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612528.781288:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893368448 00000100:00100000:2.0:1788612528.781299:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893368448 00000100:00100000:3.0:1788612528.781321:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c56300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914369024:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612528.781339:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41b05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd913 expref: 37 pid: 5854 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.781348:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612528.781380:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:2.0:1788612528.781390:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+37:2355:x1875495893368448:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612528.781420:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612528.781428:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41b05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd913 expref: 37 pid: 5854 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.781454:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd913 expref: 37 pid: 5854 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.781476:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41b05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd913 expref: 37 pid: 5854 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.781492:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:2.0:1788612528.781497:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.781505:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.781513:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.781549:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612528.781605:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+36:2355:x1875495893368448:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 215us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612528.781611:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00010000:00010000:3.0:1788612528.781994:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.782003:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612528.782019:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788612528.782232:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af41b2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd921 expref: 37 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.782249:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd921 expref: 36 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612528.782256:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:3.0:1788612528.782259:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788612528.782261:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61800, rc 0) 00000100:00100000:3.0:1788612528.782314:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+36:10343:x1875495893368320:12345-192.168.202.6@tcp:101:dd.0 Request processed in 6247us (6499us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788612528.782329:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1788612528.785643:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612528.785794:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893368704 00000100:00100000:2.0:1788612528.785804:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893368704 00000100:00100000:2.0:1788612528.786114:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:2.0:1788612528.786125:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+36:10343:x1875495893368704:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:2.0:1788612528.786395:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41b44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.786425:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41b44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612528.786450:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41b44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788612528.786502:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788612528.786525:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000892cc8be reply state 00000000be6c5317 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41b44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612528.786534:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788612528.786636:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+39:10343:x1875495893368704:12345-192.168.202.6@tcp:36:dd.0 Request processed in 512us (997us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788612528.786644:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000020:00080000:2.0:1788612528.786649:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788612528.791889:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41b44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.791907:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41b44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.791930:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41b44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.791936:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612528.791941:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41b44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.791949:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41b44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.791966:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:0.0:1788612528.791970:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612528.791975:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41b44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612528.791982:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41b44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612529.071318:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612529.071506:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893368832 00000100:00100000:2.0:1788612529.071516:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893368832 00000100:00100000:2.0:1788612529.071641:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:2.0:1788612529.071653:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+38:10357:x1875495893368832:12345-192.168.202.6@tcp:101:stat.0 00010000:00010000:2.0:1788612529.071676:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612529.071698:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41b4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd928 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.071788:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41b52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.071803:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.071814:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.072608:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41b59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.072618:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.072627:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.072711:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.072723:0:8316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd921 expref: 39 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.072730:0:8316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b60 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.072766:0:8316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd921 expref: 39 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.072782:0:8316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd921 expref: 39 pid: 5853 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612529.072796:0:8316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0748a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8316:1875495914369152:192.168.202.6@tcp:104: 00000100:00080000:0.0:1788612529.072994:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612529.073154:0:8316:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788612529.080041:0:8316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0748a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8316:1875495914369152:192.168.202.6@tcp:104: 00010000:00010000:3.0:1788612529.080080:0:8316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612529.080138:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612529.080684:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893369088 00000100:00100000:0.0:1788612529.080692:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893369088 00000100:00100000:0.0:1788612529.080802:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:0.0:1788612529.080813:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+40:5593:x1875495893369088:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788612529.081393:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+41:5593:x1875495893369088:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 580us (1573us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788612529.081411:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:3.0:1788612529.084221:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612529.084387:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893369216 00000100:00100000:1.0:1788612529.084396:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893369216 00010000:00010000:1.0:1788612529.084464:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd921 expref: 41 pid: 5853 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612529.084513:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:1.0:1788612529.084522:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+41:2355:x1875495893369216:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612529.084537:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612529.084553:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd921 expref: 41 pid: 5853 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.084567:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd921 expref: 41 pid: 5853 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.084588:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd921 expref: 41 pid: 5853 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.084605:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:1.0:1788612529.084610:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.084627:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.084635:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b60 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.084661:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612529.084712:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+40:2355:x1875495893369216:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 190us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612529.084720:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00010000:00010000:3.0:1788612529.085421:0:8316:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085434:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612529.085608:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788612529.085670:0:8316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612529.085719:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085734:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085743:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085749:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41b52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085756:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41b52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085761:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612529.085766:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41b52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085782:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41b52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085797:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:3.0:1788612529.085800:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612529.085803:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41b52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085809:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41b52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085831:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085878:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41b59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085884:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085890:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612529.085892:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085897:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41b59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085904:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e9231d800) 00010000:00010000:3.0:1788612529.085907:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612529.085910:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41b59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085926:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41b59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085970:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41b4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd928 expref: 40 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085985:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd928 expref: 39 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.085993:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:3.0:1788612529.085995:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612529.085997:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9800, rc 0) 00000100:00100000:3.0:1788612529.086045:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+39:10357:x1875495893368832:12345-192.168.202.6@tcp:101:stat.0 Request processed in 14396us (14813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612529.086054:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:3.0:1788612529.189511:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612529.189714:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893369472 00000100:00100000:1.0:1788612529.189725:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893369472 00000100:00100000:1.0:1788612529.189785:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:1.0:1788612529.189796:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+39:10363:x1875495893369472:12345-192.168.202.6@tcp:36:truncate.0 00010000:00010000:1.0:1788612529.189907:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612529.189937:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd928 expref: 39 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.189958:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:1.0:1788612529.189964:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612529.190184:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.190198:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.190208:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788612529.190271:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788612529.190293:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ff1cbde reply state 00000000085ed729 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612529.190302:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612529.190418:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+41:10363:x1875495893369472:12345-192.168.202.6@tcp:36:truncate.0 Request processed in 622us (917us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788612529.190426:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 54 00000020:00080000:1.0:1788612529.190430:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788612529.195072:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.195111:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.195120:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.195125:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612529.195130:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.195139:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.195158:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:2.0:1788612529.195160:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612529.195165:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.195171:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612529.196098:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914369280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612529.196229:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612529.196691:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914369280 00000100:00100000:3.0:1788612529.196700:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914369280 00000100:00100000:3.0:1788612529.196744:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788612529.196754:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875495914369280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612529.196788:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612529.196870:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875495914369280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612529.196877:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788612529.196957:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914369280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612529.357085:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612529.357386:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893369600 00000100:00100000:1.0:1788612529.357396:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893369600 00000100:00100000:1.0:1788612529.357463:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:1.0:1788612529.357473:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+40:10377:x1875495893369600:12345-192.168.202.6@tcp:101:stat.0 00010000:00010000:1.0:1788612529.357497:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612529.357517:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af41b6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd92f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.357581:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41b75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.357595:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41b75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.357607:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41b75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.357621:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41b7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.357627:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41b7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.357633:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41b7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.357725:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.357734:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.357758:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612529.357793:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788612529.357798:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788612529.357959:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.357974:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.357983:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41b75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.357990:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41b75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.357997:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41b75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.358003:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612529.358007:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41b75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.358015:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41b75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.358027:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:1.0:1788612529.358029:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612529.358034:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41b75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.358051:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41b75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.358064:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41b7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.358069:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41b7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.358074:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41b7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.358078:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612529.358081:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41b7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.358087:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41b7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.358094:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e838cef00) 00010000:00010000:1.0:1788612529.358096:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612529.358099:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41b7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.358105:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41b7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.358137:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af41b6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd92f expref: 42 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.358150:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd92f expref: 41 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.358163:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:1.0:1788612529.358166:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612529.358169:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61800, rc 0) 00000100:00100000:1.0:1788612529.358276:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+41:10377:x1875495893369600:12345-192.168.202.6@tcp:101:stat.0 Request processed in 804us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612529.358284:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:1.0:1788612529.468341:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612529.468459:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893369856 00000100:00100000:0.0:1788612529.468469:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893369856 00000100:00100000:0.0:1788612529.468602:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:0.0:1788612529.468626:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+41:10387:x1875495893369856:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1788612529.468647:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612529.468923:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41b8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd936 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612529.469017:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788612529.469139:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41b8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd936 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612529.469153:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928ea7bbc000) 00010000:00010000:0.0:1788612529.469314:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612529.469322:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41b8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd936 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612529.469339:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf600, rc 0) 00000100:00100000:0.0:1788612529.469404:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+42:10387:x1875495893369856:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 780us (1072us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788612529.469412:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:3.0:1788612529.472333:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612529.472437:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893370112 00000100:00100000:1.0:1788612529.472447:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893370112 00000100:00100000:1.0:1788612529.472548:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:1.0:1788612529.472559:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+42:10387:x1875495893370112:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1788612529.473071:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+43:10387:x1875495893370112:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 512us (746us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788612529.473079:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:3.0:1788612529.540378:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612529.540488:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893370368 00000100:00100000:2.0:1788612529.540499:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893370368 00000100:00100000:2.0:1788612529.540572:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:2.0:1788612529.540583:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+43:10393:x1875495893370368:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1788612529.540607:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612529.540631:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41b98 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd93d expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.540771:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.540786:0:8316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd92f expref: 44 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.540795:0:8316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.540895:0:8316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd92f expref: 44 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.540913:0:8316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd92f expref: 44 pid: 5853 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612529.540930:0:8316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec074a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8316:1875495914369408:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612529.541027:0:8316:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612529.544188:0:8316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec074a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8316:1875495914369408:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612529.544221:0:8316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612529.546343:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612529.546483:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893370496 00000100:00100000:1.0:1788612529.546495:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893370496 00010000:00010000:1.0:1788612529.546549:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd92f expref: 45 pid: 5853 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612529.546597:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:1.0:1788612529.546611:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+45:2355:x1875495893370496:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612529.546629:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612529.546636:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd92f expref: 45 pid: 5853 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.546672:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd92f expref: 45 pid: 5853 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.546693:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41b83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd92f expref: 45 pid: 5853 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.546711:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:1.0:1788612529.546717:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.546726:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.546733:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.546771:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612529.546874:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+44:2355:x1875495893370496:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 232us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612529.546891:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 40 00010000:00010000:3.0:1788612529.547621:0:8316:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.547632:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612529.547653:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788612529.547818:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41b98 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd93d expref: 45 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.547973:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd93d expref: 44 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.547980:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:3.0:1788612529.547983:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788612529.547986:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9800, rc 0) 00000100:00100000:3.0:1788612529.548032:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+44:10393:x1875495893370368:12345-192.168.202.6@tcp:101:bash.0 Request processed in 7451us (7665us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788612529.548040:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:3.0:1788612529.562054:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612529.562170:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893370752 00000100:00100000:2.0:1788612529.562181:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893370752 00000100:00100000:2.0:1788612529.562280:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:2.0:1788612529.562292:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+44:10393:x1875495893370752:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:2.0:1788612529.562592:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41bad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.562625:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.562638:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788612529.562691:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788612529.562904:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000300c9b23 reply state 000000009670c689 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612529.562913:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788612529.563123:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+47:10393:x1875495893370752:12345-192.168.202.6@tcp:36:bash.0 Request processed in 831us (1077us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788612529.563131:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00000020:00080000:2.0:1788612529.563137:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788612529.565533:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612529.565551:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41bad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612529.565558:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41bad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612529.565563:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612529.565567:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41bad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612529.565591:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41bad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612529.565608:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:0.0:1788612529.565612:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612529.565616:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41bad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612529.565623:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41bad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612529.571563:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612529.571656:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893370880 00000100:00100000:1.0:1788612529.571667:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893370880 00000100:00100000:1.0:1788612529.571732:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:1.0:1788612529.571743:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+46:10393:x1875495893370880:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1788612529.571765:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612529.571786:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41bb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd944 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.571926:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41bbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.571941:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd93d expref: 47 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.571950:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41bbb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.571989:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd93d expref: 47 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.572002:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd93d expref: 47 pid: 8316 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612529.572015:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c56300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914369536:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612529.572088:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec065bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612529.575579:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c56300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914369536:192.168.202.6@tcp:104: 00010000:00010000:3.0:1788612529.575608:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41bbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612529.575945:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612529.576415:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893371008 00000100:00100000:1.0:1788612529.576432:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893371008 00010000:00010000:1.0:1788612529.576468:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd93d expref: 48 pid: 8316 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612529.576510:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:1.0:1788612529.576519:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+48:2355:x1875495893371008:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612529.576535:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612529.576542:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd93d expref: 48 pid: 8316 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.576565:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd93d expref: 48 pid: 8316 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.576587:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41b9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd93d expref: 48 pid: 8316 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.576602:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:1.0:1788612529.576608:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41bbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.576618:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.576625:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41bbb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.576642:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612529.576700:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+47:2355:x1875495893371008:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 181us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612529.576708:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 41 00010000:00010000:2.0:1788612529.578592:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.578611:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612529.578661:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788612529.578665:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612529.578686:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.578795:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af41bb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd944 expref: 47 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.578817:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd944 expref: 46 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.579038:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:2.0:1788612529.579041:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612529.579045:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61400, rc 0) 00000100:00100000:2.0:1788612529.579145:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+46:10393:x1875495893370880:12345-192.168.202.6@tcp:101:bash.0 Request processed in 7403us (7591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612529.579154:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:0.0:1788612529.582537:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612529.582665:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893371264 00000100:00100000:2.0:1788612529.582676:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893371264 00000100:00100000:2.0:1788612529.582816:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:2.0:1788612529.582864:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e8347e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+46:10393:x1875495893371264:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:2.0:1788612529.583088:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e8347e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+47:10393:x1875495893371264:12345-192.168.202.6@tcp:35:bash.0 Request processed in 227us (559us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788612529.583095:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:1.0:1788612529.666195:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612529.666292:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893371520 00000100:00100000:0.0:1788612529.666302:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893371520 00000100:00100000:0.0:1788612529.666418:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:0.0:1788612529.666429:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+47:10404:x1875495893371520:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1788612529.666452:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612529.666473:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41bc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd94b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612529.666565:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788612529.666689:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41bc2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd94b expref: 49 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612529.666702:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928ea7bbc000) 00010000:00010000:0.0:1788612529.666705:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612529.666711:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41bc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd94b expref: 49 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612529.666739:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf800, rc 0) 00000100:00100000:0.0:1788612529.666931:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+48:10404:x1875495893371520:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 503us (746us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788612529.666939:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:0.0:1788612529.670502:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612529.670631:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893371648 00000100:00100000:3.0:1788612529.670644:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893371648 00000100:00100000:3.0:1788612529.670726:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:3.0:1788612529.670737:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+48:10404:x1875495893371648:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:3.0:1788612529.670815:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41bd0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671072:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671085:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671103:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41bd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671110:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671117:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671217:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41bde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671226:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671233:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612529.671275:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671288:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671302:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41bd0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671309:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671316:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612529.671320:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671327:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41bd0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671339:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:3.0:1788612529.671342:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612529.671347:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41bd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671354:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41bd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671367:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671373:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41bd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671379:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671384:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0076000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612529.671393:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671399:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671407:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928ea7bbcb00) 00010000:00010000:3.0:1788612529.671410:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612529.671412:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41bd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671418:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41bd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671449:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671455:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41bde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671461:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41bde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671466:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0076800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612529.671469:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41bde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671475:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41bde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671482:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:3.0:1788612529.671484:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612529.671494:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41bde lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612529.671499:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41bde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612529.671569:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+48:10404:x1875495893371648:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 833us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612529.671577:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:3.0:1788612529.674269:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612529.674626:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893371904 00000100:00100000:1.0:1788612529.674637:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893371904 00000100:00100000:1.0:1788612529.674698:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:1.0:1788612529.674709:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+48:10404:x1875495893371904:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1788612529.674983:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+49:10404:x1875495893371904:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 274us (722us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788612529.675004:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:1.0:1788612529.707298:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612529.707391:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893372160 00000100:00100000:2.0:1788612529.707402:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893372160 00000100:00100000:2.0:1788612529.707481:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:2.0:1788612529.707492:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+49:10407:x1875495893372160:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612529.707515:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612529.707535:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41be5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd952 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.707606:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41bec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.707622:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41bec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.707648:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41bec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.707663:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41bf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.707670:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.707676:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.707787:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41bfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.707797:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.707804:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612529.707814:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000100:00100000:1.0:1788612529.708376:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914369920:0@lo:400:kworker.0 00000100:00100000:1.0:1788612529.708429:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612529.708496:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612529.708502:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914369792:0@lo:400:kworker.0 00000100:00100000:1.0:1788612529.708526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612529.708554:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914369920 00000100:00100000:1.0:1788612529.708559:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914369920 00000100:00100000:1.0:1788612529.708591:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914369792 00000100:00100000:1.0:1788612529.708594:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914369792 00000100:00100000:1.0:1788612529.708607:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788612529.708614:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875495914369920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612529.708657:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875495914369920:12345-0@lo:400:kworker.0 Request processed in 44us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612529.708664:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788612529.708699:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914369920:0@lo:400:kworker.0 00000100:00100000:1.0:1788612529.708721:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788612529.708727:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914369792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612529.708758:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914369792:12345-0@lo:400:kworker.0 Request processed in 31us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612529.708763:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788612529.708783:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914369792:0@lo:400:kworker.0 00000100:00100000:0.0:1788612529.708975:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914369664:0@lo:400:kworker.0 00000100:00100000:0.0:1788612529.709010:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612529.709043:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914370176:0@lo:400:kworker.0 00000100:00100000:0.0:1788612529.709068:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612529.709093:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612529.709099:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914370048:0@lo:400:kworker.0 00000100:00100000:0.0:1788612529.709121:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788612529.709142:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612529.709152:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914370048 00000100:00100000:0.0:1788612529.709156:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914370048 00000100:00100000:0.0:1788612529.709182:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788612529.709188:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914370048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612529.709224:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914370048:12345-0@lo:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612529.709230:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1788612529.709243:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612529.709260:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914370048:0@lo:400:kworker.0 00000100:00100000:3.0:1788612529.709351:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914370176 00000100:00100000:3.0:1788612529.709355:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914370176 00000100:00100000:3.0:1788612529.709396:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788612529.709404:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914370176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612529.709442:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914370176:12345-0@lo:400:kworker.0 Request processed in 40us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612529.709449:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788612529.709471:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914370176:0@lo:400:kworker.0 00010000:00010000:2.0:1788612529.709715:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41bec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.709725:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41bec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.709732:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41bec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.709738:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612529.709754:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41bec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.709761:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41bec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.709777:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:2.0:1788612529.709780:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612529.709784:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41bec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.709790:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41bec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.709804:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.709810:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41bf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.709816:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.709978:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612529.709983:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.709990:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.709998:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e9231de00) 00010000:00010000:2.0:1788612529.710000:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612529.710010:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41bf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.710015:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41bf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.710072:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41be5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd952 expref: 52 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.710087:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41bfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd952 expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.710094:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:2.0:1788612529.710096:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612529.710098:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8c00, rc 0) 00000100:00100000:2.0:1788612529.710144:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+51:10407:x1875495893372160:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 2654us (2857us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788612529.710150:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00080000:0.0:1788612529.710215:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612529.711217:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914369664 00000100:00100000:1.0:1788612529.711226:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914369664 00000100:00100000:1.0:1788612529.711287:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788612529.711296:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3308:x1875495914369664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612529.711361:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3308:x1875495914369664:12345-0@lo:400:kworker.0 Request processed in 67us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612529.711367:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788612529.711789:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914369664:0@lo:400:kworker.0 00000100:00100000:0.0:1788612529.714789:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612529.714967:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893372288 00000100:00100000:2.0:1788612529.714978:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893372288 00000100:00100000:2.0:1788612529.715044:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:2.0:1788612529.715055:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e98e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+51:10407:x1875495893372288:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:2.0:1788612529.715133:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.715151:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.715163:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.715212:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.715219:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.715226:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.715232:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612529.715238:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.715245:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.715257:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:2.0:1788612529.715260:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612529.715264:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.715269:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612529.715339:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e98e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+51:10407:x1875495893372288:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 285us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612529.715347:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:3.0:1788612529.718462:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612529.718760:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893372544 00000100:00100000:1.0:1788612529.718770:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893372544 00000100:00100000:1.0:1788612529.718856:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1788612529.718867:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+51:10407:x1875495893372544:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1788612529.719104:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:10407:x1875495893372544:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 237us (652us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788612529.719112:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1788612529.721348:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612529.721445:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893372672 00000100:00100000:0.0:1788612529.721456:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893372672 00000100:00100000:0.0:1788612529.721525:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:0.0:1788612529.721534:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:2355:x1875495893372672:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612529.721549:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612529.721573:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41bfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd952 expref: 52 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612529.721590:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:0.0:1788612529.721595:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612529.721651:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+51:2355:x1875495893372672:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 118us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612529.721658:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00010000:00010000:1.0:1788612529.772141:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612529.908295:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612529.908465:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893372928 00000100:00100000:2.0:1788612529.908475:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893372928 00000100:00100000:2.0:1788612529.908538:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:2.0:1788612529.908562:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+51:10425:x1875495893372928:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:2.0:1788612529.908588:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612529.908609:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd959 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.908729:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41c16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.908744:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41c16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.908755:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41c16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612529.908764:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788612529.908916:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd959 expref: 54 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.908934:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41c16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd959 expref: 53 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.908942:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:2.0:1788612529.908945:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788612529.908949:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9a00, rc 0) 00000100:00100000:2.0:1788612529.909009:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+53:10425:x1875495893372928:12345-192.168.202.6@tcp:101:cat.0 Request processed in 449us (726us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788612529.909016:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:3.0:1788612529.968933:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612529.969278:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893373056 00000100:00100000:2.0:1788612529.969290:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893373056 00000100:00100000:2.0:1788612529.969372:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:2.0:1788612529.969382:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+53:10426:x1875495893373056:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612529.969408:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612529.969431:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd960 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.969500:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.969515:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.969528:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612529.969562:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788612529.969566:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612529.969588:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.969616:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd960 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.970246:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd960 expref: 54 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612529.970256:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:2.0:1788612529.970259:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612529.970263:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8200, rc 0) 00000100:00100000:2.0:1788612529.970459:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:10426:x1875495893373056:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1076us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612529.970478:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:1.0:1788612529.978251:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612529.978512:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893373440 00000100:00100000:0.0:1788612529.978523:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893373440 00000100:00100000:0.0:1788612529.978584:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:0.0:1788612529.978594:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:10426:x1875495893373440:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1788612529.979084:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:10426:x1875495893373440:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 489us (841us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788612529.979092:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:0.0:1788612529.985905:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612529.985996:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893373568 00000100:00100000:1.0:1788612529.986006:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893373568 00000100:00100000:1.0:1788612529.986147:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1788612529.986370:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:10426:x1875495893373568:12345-192.168.202.6@tcp:103:lfs.0 00010000:00010000:1.0:1788612529.986388:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788612529.986413:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41bbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd944 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.986503:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41c16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd959 expref: 54 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.986517:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ac6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd905 expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.986543:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb500) 00010000:00010000:1.0:1788612529.986554:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612529.986614:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:10426:x1875495893373568:12345-192.168.202.6@tcp:103:lfs.0 Request processed in 458us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612529.986621:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:3.0:1788612529.991572:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612529.991658:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893373696 00000100:00100000:1.0:1788612529.991669:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893373696 00000100:00100000:1.0:1788612529.991728:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:1.0:1788612529.991738:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:10426:x1875495893373696:12345-192.168.202.6@tcp:58:lfs.0 00010000:00010000:1.0:1788612529.991894:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41c32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.991912:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41c32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612529.991925:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41c32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612529.993607:0:8316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612529.993944:0:8316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788612529.994016:0:8316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788612529.995834:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:10426:x1875495893373696:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 4076us (4252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612529.995864:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:3.0:1788612530.019793:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612530.019946:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893373824 00000100:00100000:2.0:1788612530.019956:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893373824 00000100:00100000:2.0:1788612530.020008:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:2.0:1788612530.020016:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:10428:x1875495893373824:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612530.020033:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612530.020058:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd967 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020114:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41c40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020126:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41c40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020135:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41c40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020144:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41c47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020149:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020153:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020244:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41c4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020264:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020269:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612530.020420:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788612530.020424:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612530.020446:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020457:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020463:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41c40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020468:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41c40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020473:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41c40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020476:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612530.020481:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41c40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020489:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41c40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020500:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:2.0:1788612530.020503:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612530.020515:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41c40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020521:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41c40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020537:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020543:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41c47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020547:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020550:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612530.020552:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020555:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41c47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020560:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e9231de00) 00010000:00010000:2.0:1788612530.020561:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612530.020563:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41c47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020566:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41c47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020591:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41c39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd967 expref: 54 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020613:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd967 expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.020620:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e838cef00) 00010000:00010000:2.0:1788612530.020622:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612530.020625:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9e00, rc 0) 00000100:00100000:2.0:1788612530.020688:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+53:10428:x1875495893373824:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 672us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612530.020696:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:0.0:1788612530.106342:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612530.106384:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612530.106401:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893373952 00000100:00100000:3.0:1788612530.106413:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893373952 00000100:00100000:0.0:1788612530.106424:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612530.106467:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612530.106476:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893374208 00000100:00100000:2.0:1788612530.106482:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893374208 00000100:00100000:2.0:1788612530.106559:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:2.0:1788612530.106571:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2353:x1875495893374208:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612530.106658:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2353:x1875495893374208:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 89us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612530.106666:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00080000:0.0:1788612530.106876:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612530.107625:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 285 00000100:00100000:3.0:1788612530.107637:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2353:x1875495893373952:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612530.107697:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2353:x1875495893373952:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 63us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612530.107716:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 285 00000100:00100000:1.0:1788612530.107821:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893374080 00000100:00100000:1.0:1788612530.107864:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893374080 00000100:00100000:0.0:1788612530.107904:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893374336 00000100:00100000:1.0:1788612530.107909:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 130 00000100:00100000:0.0:1788612530.107910:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893374336 00000100:00100000:1.0:1788612530.107920:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+53:2353:x1875495893374080:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:0.0:1788612530.107933:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612530.107964:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:1.0:1788612530.107976:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+53:2353:x1875495893374080:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 55us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612530.107977:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893374336:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612530.107991:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 130 00000100:00100000:0.0:1788612530.108015:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893374336:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 43us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612530.108023:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:0.0:1788612530.220780:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612530.220803:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914370304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612530.220915:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612530.220986:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914370304 00000100:00100000:0.0:1788612530.220994:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914370304 00000100:00100000:0.0:1788612530.221043:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788612530.221051:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914370304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612530.221084:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612530.221128:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914370304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612530.221135:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788612530.221193:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914370304:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788612530.341516:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:3.0:1788612530.341540:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788612530.341559:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff928ec00dc300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788612530.341564:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928ea7a42f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff928ec00dcf00 00000020:00080000:3.0:1788612530.341568:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928ea7a42100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff928eacc8cc00 00000100:00100000:3.0:1788612530.342117:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914370432:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788612530.342181:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612530.342298:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914370432 00000100:00100000:1.0:1788612530.342306:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914370432 00000100:00100000:1.0:1788612530.342557:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788612530.342567:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875495914370432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788612530.342594:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1788612530.342626:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9c0fb0, atime: 0x6a9c0fb0, ctime: 0x6a9c0fb0, blocks: 0x1 00010000:00010000:1.0:1788612530.342635:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee005efe/0xfc956d548af41c55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.342651:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:1.0:1788612530.342656:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612530.342663:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee005efe/0xfc956d548af41c55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.342679:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee005efe/0xfc956d548af41c55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.342690:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee005efe/0xfc956d548af41c55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.342697:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee005efe/0xfc956d548af41c55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.342728:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788612530.343362:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1875495914370432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 794us (1179us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788612530.343371:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788612530.343530:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612530.343537:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee005efe/0xfc956d548af41c55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.343547:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60e00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612530.343552:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee005efe/0xfc956d548af41c55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.343576:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee005efe/0xfc956d548af41c55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.343593:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee005efe/0xfc956d548af41c55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.343600:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee005efe/0xfc956d548af41c55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.343620:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612530.343622:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612530.343624:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788612530.343789:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788612530.343923:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00080000:3.0:1788612530.344167:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788612530.344265:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff928eacd2dc00/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788612530.344274:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914370432:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788612530.796013:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788612530.860047:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788612530.860056:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612530.860108:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788612530.860115:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788612530.860231:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0748000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875495914370560:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788612530.860312:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788612530.868072:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612530.868665:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893374464 00000100:00100000:2.0:1788612530.868678:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893374464 00000100:00100000:2.0:1788612530.868724:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:2.0:1788612530.868732:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:10439:x1875495893374464:12345-192.168.202.6@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788612530.868811:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:10439:x1875495893374464:12345-192.168.202.6@tcp:900:lhsmtool_posix.0 Request processed in 79us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612530.868819:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:2.0:1788612530.868988:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0748000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875495914370560:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788612530.875820:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612530.877454:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893374592 00000100:00100000:0.0:1788612530.877467:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893374592 00000100:00100000:0.0:1788612530.877524:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:0.0:1788612530.877532:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:10439:x1875495893374592:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788612530.877562:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788612530.877659:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:10439:x1875495893374592:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 126us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612530.877667:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:1.0:1788612530.882896:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612530.885204:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893374720 00000100:00100000:0.0:1788612530.885221:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893374720 00000100:00100000:0.0:1788612530.885281:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1788612530.885291:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:10439:x1875495893374720:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788612530.885415:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41c5c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885433:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41c5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885445:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41c5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885474:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41c63 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885483:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41c63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885490:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41c63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885518:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41c6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885527:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885533:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612530.885569:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788612530.885573:0:8316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612530.885597:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885609:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41c5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885622:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41c5c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885629:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41c5c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885635:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdee00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612530.885640:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41c5c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885648:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41c5c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885660:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb600) 00010000:00010000:0.0:1788612530.885663:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612530.885668:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41c5c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885674:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41c5c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885684:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41c63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885689:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41c63 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885695:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41c63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885699:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612530.885707:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41c63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885712:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41c63 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885720:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff928e91fbb300) 00010000:00010000:0.0:1788612530.885722:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612530.885725:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41c63 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885730:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41c63 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885743:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.885748:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41c6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.886340:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.886346:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdfc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612530.886350:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.886357:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41c6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.886366:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e838cef00) 00010000:00010000:0.0:1788612530.886368:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612530.886377:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41c6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.886383:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41c6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612530.886459:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:10439:x1875495893374720:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 1166us (3575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612530.886467:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:3.0:1788612530.893752:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612530.893945:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893374976 00000100:00100000:0.0:1788612530.893956:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893374976 00000100:00100000:0.0:1788612530.894053:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:0.0:1788612530.894065:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:10439:x1875495893374976:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612530.894088:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612530.894110:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41c71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd96e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.894223:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41c78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.894238:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.894249:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612530.894260:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788612530.894448:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.894456:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41c78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.894468:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41c78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.894474:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdec00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612530.894479:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41c78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.894487:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41c78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.894499:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e838cef00) 00010000:00010000:0.0:1788612530.894502:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612530.894506:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41c78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.894513:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41c78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.894549:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41c71 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd96e expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.894559:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb600) 00010000:00010000:0.0:1788612530.894561:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612530.894565:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41c71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd96e expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612530.894575:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bde600, rc 0) 00000100:00100000:0.0:1788612530.894629:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:10439:x1875495893374976:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 566us (887us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788612530.894644:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:3.0:1788612530.899258:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612530.899330:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893375104 00000100:00100000:0.0:1788612530.899339:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893375104 00000100:00100000:0.0:1788612530.899395:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:0.0:1788612530.899404:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:10439:x1875495893375104:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788612530.899438:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788612530.899552:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:10439:x1875495893375104:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 148us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612530.899559:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:1.0:1788612530.913658:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612530.913712:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893375360 00000100:00100000:2.0:1788612530.913723:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893375360 00000100:00100000:2.0:1788612530.913798:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:2.0:1788612530.913809:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:10439:x1875495893375360:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612530.913875:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612530.913879:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788612530.913905:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41c2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd960 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.913937:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:2.0:1788612530.913943:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612530.913958:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41c86 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd975 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788612530.914690:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788612530.914961:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41c8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.914976:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.914992:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.915052:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41c86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd975 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.915067:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd975 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612530.915075:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff928e9231de00) 00010000:00010000:2.0:1788612530.915078:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612530.915081:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9a00, rc 0) 00000100:00100000:2.0:1788612530.915143:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:10439:x1875495893375360:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1335us (1502us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788612530.915151:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00000040:00080000:2.0:1788612530.928380:0:12004:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788612530.928391:0:12004:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612530.928429:0:12004:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788612530.928435:0:12004:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788612530.931421:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612530.931617:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893375616 00000100:00100000:1.0:1788612530.931627:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893375616 00000100:00100000:1.0:1788612530.932064:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:1.0:1788612530.932076:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:10439:x1875495893375616:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788612530.932138:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612530.932163:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41c8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd975 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932194:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff928e9231de00) 00010000:00010000:1.0:1788612530.932208:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612530.932231:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af41c9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932246:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af41c9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932256:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af41c9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932271:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41ca2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd3667c8b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932285:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd3667c8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932292:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd3667c8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932630:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af41c9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932640:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af41c9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932646:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af41c9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932653:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612530.932657:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af41c9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932665:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af41c9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932676:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:1.0:1788612530.932679:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612530.932682:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af41c9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932688:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af41c9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932697:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd3667c8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932708:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41ca2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd3667c8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932714:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd3667c8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932719:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612530.932722:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd3667c8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932727:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41ca2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd3667c8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932735:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd3667c8b (ffff928e838ceb00) 00010000:00010000:1.0:1788612530.932737:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612530.932740:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41ca2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd3667c8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.932746:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41ca2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd3667c8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612530.933086:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:10439:x1875495893375616:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 1010us (1673us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788612530.933094:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:1.0:1788612530.936660:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612530.936739:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893375744 00000100:00100000:3.0:1788612530.936750:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893375744 00000100:00100000:3.0:1788612530.936883:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:3.0:1788612530.936894:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:10439:x1875495893375744:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612530.936916:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612530.936941:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41ca9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd97c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612530.936979:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41cb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612530.936992:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612530.937011:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612530.937104:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41ca9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd97c expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612530.937122:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd97c expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612530.937131:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff928ea7bbc600) 00010000:00010000:3.0:1788612530.937133:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788612530.937138:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0076000, rc 0) 00000100:00100000:3.0:1788612530.937415:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:10439:x1875495893375744:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 522us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612530.937423:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:0.0:1788612530.940203:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612530.940410:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893376000 00000100:00100000:3.0:1788612530.940421:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893376000 00000100:00100000:3.0:1788612530.940565:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 75 00000100:00100000:3.0:1788612530.940576:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:10439:x1875495893376000:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788612530.940660:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41cb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612530.940675:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612530.940687:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788612530.941065:0:8316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788612530.941076:0:8316:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 324784237680ns, next at 325784235691ns, rc = 0 00000004:00010000:3.0:1788612530.941178:0:8316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7ab5050 reply state 00000000c53caacc transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612530.941188:0:8316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788612530.941288:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:10439:x1875495893376000:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 713us (1094us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788612530.941295:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 75 00000100:00100000:0.0:1788612530.944147:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612530.944221:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893376128 00000100:00100000:1.0:1788612530.944232:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893376128 00000100:00100000:1.0:1788612530.944294:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:1.0:1788612530.944305:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:10439:x1875495893376128:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612530.944346:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612530.944369:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41cbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd983 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.944452:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41cbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd983 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.944467:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41cbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd983 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612530.944486:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff928ea7bbc600) 00010000:00010000:1.0:1788612530.944489:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612530.944493:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60e00, rc 0) 00000100:00100000:1.0:1788612530.944546:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:10439:x1875495893376128:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 243us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612530.944553:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 76 00010000:00010000:3.0:1788612530.949131:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612530.949149:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41cb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612530.949156:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41cb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612530.949162:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612530.949167:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41cb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612530.949185:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41cb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612530.949203:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff928ea7bbc600) 00010000:00010000:3.0:1788612530.949206:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788612530.949211:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41cb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612530.949236:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41cb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612530.949613:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612530.949673:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893376256 00000100:00100000:0.0:1788612530.949683:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893376256 00000100:00100000:0.0:1788612530.949723:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:0.0:1788612530.949732:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875495893376256:12345-192.168.202.6@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788612530.949760:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp t0 exp 0000000000000000 cur 324 last 0 00000020:00000080:0.0:1788612530.949789:0:6698:0:(genops.c:1385:class_connect()) connect: client f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab, cookie 0xfc956d548af41cc5 00002000:00100000:0.0:1788612530.949800:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab/ffff928d853b6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788612530.949810:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788612530.950166:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788612530.950318:0:6698:0:(import.c:65:import_set_state_nolock()) ffff928d853b4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612530.950451:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2352:x1875495893376256:12345-192.168.202.6@tcp:8:lhsmtool_posix.0 Request processed in 718us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612530.950469:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:0.0:1788612530.968376:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612530.968460:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893376384 00000100:00100000:3.0:1788612530.968470:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893376384 00000100:00100000:3.0:1788612530.968538:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:3.0:1788612530.968549:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:0:x1875495893376384:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788612530.969214:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612531.039678:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:0:x1875495893376384:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 71119us (71300us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788612531.039693:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000001:00100000:2.0:1788612531.039969:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000001:00080000:2.0:1788612531.039985:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1788612531.042247:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612531.042319:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893376640 00000100:00100000:3.0:1788612531.042329:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893376640 00000100:00100000:3.0:1788612531.042393:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:3.0:1788612531.042402:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec074a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:10439:x1875495893376640:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788612531.042614:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec074a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:10439:x1875495893376640:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 212us (376us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788612531.042622:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00080000:2.0:1788612531.042743:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612531.044575:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612531.044733:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893376896 00000100:00100000:0.0:1788612531.044741:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893376896 00000100:00100000:0.0:1788612531.044795:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:0.0:1788612531.044804:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:10439:x1875495893376896:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788612531.045376:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:10439:x1875495893376896:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 571us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612531.045385:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:3.0:1788612531.047272:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612531.047425:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893377024 00000100:00100000:0.0:1788612531.047434:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893377024 00000100:00100000:0.0:1788612531.047516:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:0.0:1788612531.047527:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:10439:x1875495893377024:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612531.047545:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612531.047566:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41ccc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd98a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.047635:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41cd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.047649:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.047661:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612531.047706:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612531.047738:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.047779:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41ccc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd98a expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.047798:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd98a expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.047807:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff928ea7bbc600) 00010000:00010000:0.0:1788612531.047810:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788612531.047814:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf800, rc 0) 00000100:00100000:0.0:1788612531.047899:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:10439:x1875495893377024:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 373us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612531.047906:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:2.0:1788612531.052517:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612531.052577:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893377152 00000100:00100000:3.0:1788612531.052598:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893377152 00000100:00100000:3.0:1788612531.052704:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:3.0:1788612531.052716:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2354:x1875495893377152:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612531.052736:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612531.052779:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d82e72ea/0xfc956d548af41cda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd991 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612531.052809:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c0fb3, blocks: 0x1 00010000:00010000:3.0:1788612531.052862:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=324s v=(0 0) 00010000:00010000:3.0:1788612531.052867:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612531.052877:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d82e72ea/0xfc956d548af41cda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd991 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.052900:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d82e72ea/0xfc956d548af41cda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd991 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.052913:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077200, rc 0) 00000100:00100000:3.0:1788612531.052976:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2354:x1875495893377152:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 262us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612531.052983:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:3.0:1788612531.058660:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612531.062787:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893377408 00000100:00100000:0.0:1788612531.062804:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893377408 00000100:00100000:0.0:1788612531.062898:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:0.0:1788612531.062909:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:10439:x1875495893377408:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788612531.063396:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:10439:x1875495893377408:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 486us (4743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612531.063406:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:2.0:1788612531.080306:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612531.080371:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893377536 00000100:00100000:3.0:1788612531.080381:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893377536 00000100:00100000:3.0:1788612531.080444:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:3.0:1788612531.080455:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:10439:x1875495893377536:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612531.080473:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612531.080492:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0da9944/0xfc956d548af41ce1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd998 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.080524:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d82e72ea/0xfc956d548af41cda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd991 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.080550:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612531.080555:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612531.080561:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0da9944/0xfc956d548af41ce1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd998 expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.080596:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d82e72ea/0xfc956d548af41cda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd991 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.080611:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d82e72ea/0xfc956d548af41cda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd991 expref: 7 pid: 6695 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612531.080625:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1875495914370688:192.168.202.6@tcp:104: 00000100:00100000:3.0:1788612531.080714:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c25840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612531.083374:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1875495914370688:192.168.202.6@tcp:104: 00010000:00010000:3.0:1788612531.083416:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0da9944/0xfc956d548af41ce1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd998 expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.083439:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0076800, rc 0) 00000100:00100000:3.0:1788612531.083503:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:10439:x1875495893377536:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 3049us (3209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612531.083512:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:2.0:1788612531.089171:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612531.089243:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893377664 00000100:00100000:3.0:1788612531.089256:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893377664 00010000:00010000:3.0:1788612531.089307:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d82e72ea/0xfc956d548af41cda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd991 expref: 7 pid: 6695 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612531.089374:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:3.0:1788612531.089384:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9238d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2356:x1875495893377664:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612531.089402:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612531.089428:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d82e72ea/0xfc956d548af41cda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd991 expref: 7 pid: 6695 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.089443:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d82e72ea/0xfc956d548af41cda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd991 expref: 7 pid: 6695 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.089465:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d82e72ea/0xfc956d548af41cda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd991 expref: 7 pid: 6695 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.089480:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612531.089484:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612531.089492:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0da9944/0xfc956d548af41ce1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd998 expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.089502:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0da9944/0xfc956d548af41ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd998 expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.089540:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b0da9944/0xfc956d548af41ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd998 expref: 6 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612531.089555:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc3e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5837:1875495914370816:192.168.202.6@tcp:105: 00000100:00100000:3.0:1788612531.089637:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c25840 going to sleep for 11 seconds 00000100:00100000:0.0:1788612531.099022:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc3e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5837:1875495914370816:192.168.202.6@tcp:105: 00010000:00010000:0.0:1788612531.099052:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612531.099983:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9238d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893377664:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 10592us (10814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612531.099997:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:3.0:1788612531.110945:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612531.112481:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893377792 00000100:00100000:3.0:1788612531.112498:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893377792 00002000:00100000:3.0:1788612531.112556:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff928ebfc3ca80 x1875495893377792/t0(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:177/0 lens 504/0 e 0 to 0 dl 1788612542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612531.112568:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928ebfc3ca80 with x1875495893377792 ext(0->8) 00002000:00010000:3.0:1788612531.112573:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928ebfc3ca80 00000100:00100000:3.0:1788612531.112605:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1788612531.112613:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893377792:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788612531.116553:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2355:x1875495893377792:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 Request processed in 3931us (5609us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788612531.116567:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00002000:00100000:3.0:1788612531.116580:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff928ebfc3ca80 x1875495893377792/t4294967302(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:177/0 lens 504/448 e 0 to 0 dl 1788612542 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612531.116589:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928ebfc3ca80 with x1875495893377792 ext(0->8) 00002000:00010000:3.0:1788612531.116596:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928ebfc3ca80 00000100:00100000:2.0:1788612531.124220:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612531.124258:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893377920 00000100:00100000:2.0:1788612531.124269:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893377920 00000100:00100000:2.0:1788612531.124324:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:2.0:1788612531.124333:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:10439:x1875495893377920:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788612531.176607:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:0.0:1788612531.176628:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000020:00080000:0.0:1788612531.176635:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1788612531.176673:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1788612531.176690:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1788612531.176868:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914370944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788612531.176954:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612531.177009:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914370944 00000100:00100000:0.0:1788612531.177016:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914370944 00000100:00100000:0.0:1788612531.177070:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788612531.177080:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914370944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788612531.177242:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788612531.177246:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788612531 00002000:00010000:0.0:1788612531.177248:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788612531.177250:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788612531 -> 1788612531 00002000:00010000:0.0:1788612531.177252:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788612531.177293:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875495914370944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 215us (339us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788612531.177301:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1788612531.177345:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff928ec0828e00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788612531.177350:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914370944:0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1788612531.177620:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788612531.177635:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00080000:2.0:1788612531.177710:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612531.178563:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:10439:x1875495893377920:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 54225us (54348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612531.178574:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:1.0:1788612531.182008:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612531.182406:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893378048 00000100:00100000:3.0:1788612531.182418:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893378048 00000100:00100000:3.0:1788612531.182581:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:3.0:1788612531.182594:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2356:x1875495893378048:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788612531.214163:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1788612531.214196:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1788612531.214418:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893378048:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 31820us (32414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612531.214430:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:2.0:1788612531.219626:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612531.219725:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893378304 00000100:00100000:1.0:1788612531.219736:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893378304 00000100:00100000:1.0:1788612531.219795:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:1.0:1788612531.219815:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:10439:x1875495893378304:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788612531.219911:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612531.219941:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41cd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd98a expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612531.219973:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff928ea7bbc600) 00010000:00010000:1.0:1788612531.219979:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612531.220008:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af41ce8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612531.220021:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af41ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612531.220031:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af41ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612531.220313:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9080851 reply state 00000000339b140d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af41ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612531.220323:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612531.220420:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:10439:x1875495893378304:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 606us (803us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788612531.220427:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00010000:00010000:0.0:1788612531.223173:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af41ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.223201:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af41ce8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.223209:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af41ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.223215:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612531.223221:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af41ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.223243:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af41ce8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.223259:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff928ea7bbc600) 00010000:00010000:0.0:1788612531.223262:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612531.223266:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af41ce8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.223273:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af41ce8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612531.225370:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612531.225445:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893378432 00000100:00100000:0.0:1788612531.225455:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893378432 00000100:00100000:0.0:1788612531.225518:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:0.0:1788612531.225529:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893378432:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788612531.225792:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788612531.225795:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788612531 -> 1788612529 00002000:00010000:0.0:1788612531.225798:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788612528 00002000:00010000:0.0:1788612531.225800:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788612531 -> 1788612529 00002000:00010000:0.0:1788612531.225803:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788612531.225911:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2355:x1875495893378432:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 382us (549us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788612531.225918:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:2.0:1788612531.229054:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612531.229126:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893378688 00000100:00100000:0.0:1788612531.229136:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893378688 00000100:00100000:0.0:1788612531.229198:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:0.0:1788612531.229207:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:10439:x1875495893378688:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788612531.229291:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.229308:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41cb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd97c expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.229317:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.229349:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd97c expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.229362:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41cb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd97c expref: 13 pid: 5852 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612531.229376:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0828000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914371072:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612531.229479:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e829dca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612531.232632:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612531.232740:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0828000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914371072:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612531.232769:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612531.232971:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893378816 00000100:00100000:3.0:1788612531.232978:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893378816 00010000:00010000:3.0:1788612531.233017:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41cb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd97c expref: 14 pid: 5852 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612531.233057:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:3.0:1788612531.233068:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:2355:x1875495893378816:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612531.233082:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612531.233088:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41cb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd97c expref: 14 pid: 5852 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.233101:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd97c expref: 14 pid: 5852 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.233122:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41cb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd97c expref: 14 pid: 5852 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.233138:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff928ea7bbc600) 00010000:00010000:3.0:1788612531.233144:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.233153:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.233161:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.233193:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612531.233244:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:2355:x1875495893378816:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 177us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612531.233258:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 43 00010000:00010000:0.0:1788612531.233526:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.233535:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.233562:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.233579:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.233585:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.233590:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612531.233595:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.233602:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.233611:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff928ea7bbc600) 00010000:00010000:0.0:1788612531.233613:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788612531.233617:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.233623:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41cef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612531.233671:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:10439:x1875495893378688:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 Request processed in 4465us (4627us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788612531.233678:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:1.0:1788612531.237256:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612531.237343:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893378944 00000100:00100000:0.0:1788612531.237353:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893378944 00000100:00100000:0.0:1788612531.237414:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:0.0:1788612531.237424:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2356:x1875495893378944:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788612531.237483:0:8463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075e403ea/0xfc956d548af41cf6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.237520:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0da9944/0xfc956d548af41ce1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd998 expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.237529:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788612531.237533:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612531.237537:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075e403ea/0xfc956d548af41cf6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.237570:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0da9944/0xfc956d548af41ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd998 expref: 7 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.237583:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0da9944/0xfc956d548af41ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd998 expref: 7 pid: 8463 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612531.237597:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0828000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1875495914371200:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612531.237678:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e829dca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612531.245129:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612531.245250:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0828000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1875495914371200:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612531.245280:0:8463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075e403ea/0xfc956d548af41cf6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612531.245366:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893379072 00000100:00100000:2.0:1788612531.245373:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893379072 00010000:00010000:2.0:1788612531.245412:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0da9944/0xfc956d548af41ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd998 expref: 8 pid: 8463 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612531.245457:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:2.0:1788612531.245467:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2355:x1875495893379072:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612531.245483:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612531.245508:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0da9944/0xfc956d548af41ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd998 expref: 8 pid: 8463 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612531.245521:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0da9944/0xfc956d548af41ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd998 expref: 8 pid: 8463 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612531.245562:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0da9944/0xfc956d548af41ce1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd998 expref: 8 pid: 8463 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612531.245579:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788612531.245584:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788612531.245591:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075e403ea/0xfc956d548af41cf6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612531.245600:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075e403ea/0xfc956d548af41cf6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612531.245637:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612531.245702:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2355:x1875495893379072:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 234us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612531.245709:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00010000:00010000:3.0:1788612531.246166:0:8463:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075e403ea/0xfc956d548af41cf6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.246177:0:8463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075e403ea/0xfc956d548af41cf6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.246202:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075e403ea/0xfc956d548af41cf6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.246211:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075e403ea/0xfc956d548af41cf6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.246218:0:8463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075e403ea/0xfc956d548af41cf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.246225:0:8463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdea00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612531.246229:0:8463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075e403ea/0xfc956d548af41cf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.246237:0:8463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075e403ea/0xfc956d548af41cf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.246249:0:8463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075e403ea/0xfc956d548af41cf6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.246270:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075e403ea/0xfc956d548af41cf6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612531.246327:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893378944:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 8904us (9081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612531.246335:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:3.0:1788612531.249819:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612531.250230:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893379328 00000100:00100000:1.0:1788612531.250240:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893379328 00000100:00100000:1.0:1788612531.250329:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00100000:1.0:1788612531.250340:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:10439:x1875495893379328:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788612531.250444:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af41cfd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612531.250462:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af41cfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612531.250487:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af41cfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612531.250808:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612531.250820:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41cbe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd983 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612531.251040:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612531.251077:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41cbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd983 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612531.251092:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41cbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd983 expref: 13 pid: 5854 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612531.251106:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec034c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914371328:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612531.251322:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90aaec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612531.254393:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec034c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914371328:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612531.254424:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612531.256295:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612531.256535:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893379456 00000100:00100000:2.0:1788612531.256543:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893379456 00010000:00010000:2.0:1788612531.256584:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41cbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd983 expref: 14 pid: 5854 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612531.256626:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:2.0:1788612531.256636:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:2356:x1875495893379456:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612531.256651:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612531.256658:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41cbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd983 expref: 14 pid: 5854 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612531.256697:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41cbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd983 expref: 14 pid: 5854 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612531.256721:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af41cbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd983 expref: 14 pid: 5854 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612531.256739:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff928ea7bbc600) 00010000:00010000:2.0:1788612531.256745:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612531.256754:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612531.256762:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612531.256800:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612531.256909:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:2356:x1875495893379456:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 274us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612531.256917:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00010000:00010000:0.0:1788612531.257116:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.257125:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612531.257336:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788612531.257490:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788612531.257538:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788612531.257617:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0828000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5853:1875495914371456:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788612531.257729:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612531.257765:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e92428d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612531.258140:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914371456 00000100:00100000:2.0:1788612531.258147:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914371456 00000100:00100000:2.0:1788612531.258269:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612531.258279:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1875495914371456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788612531.258487:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1875495914371456:12345-0@lo:1000:mdt00_001.0 Request processed in 209us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612531.258494:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788612531.259385:0:5853:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788612531.259393:0:5853:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff928ec0828e00, transno 4294967303 00000100:00100000:0.0:1788612531.259539:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0828000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5853:1875495914371456:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788612531.260144:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788612531.260236:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec034c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5853:1875495914371584:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788612531.260296:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612531.260338:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90aae9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612531.260612:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914371584 00000100:00100000:2.0:1788612531.260619:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914371584 00000100:00100000:2.0:1788612531.260661:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612531.260669:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875495914371584:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788612531.260921:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875495914371584:12345-0@lo:1000:mdt00_001.0 Request processed in 252us (624us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788612531.260929:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612531.261202:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec034c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5853:1875495914371584:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788612531.261240:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261249:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261256:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261261:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612531.261265:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261272:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261287:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff928ea7bbc600) 00010000:00010000:0.0:1788612531.261290:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788612531.261303:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261309:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41d04 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261346:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41c32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261352:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41c32 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261358:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41c32 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261363:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612531.261366:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41c32 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261372:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41c32 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261380:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e838cef00) 00010000:00010000:0.0:1788612531.261382:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788612531.261385:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41c32 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261390:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af41c32 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261445:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261460:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41c4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd967 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261475:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261505:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd967 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.261519:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41c4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd967 expref: 16 pid: 5853 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612531.261531:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec082bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914371712:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612531.261604:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e92428c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612531.266188:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec082bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914371712:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612531.266223:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612531.268190:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612531.268622:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893379584 00000100:00100000:3.0:1788612531.268633:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893379584 00010000:00010000:3.0:1788612531.268676:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41c4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd967 expref: 17 pid: 5853 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612531.268729:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:3.0:1788612531.268740:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:2356:x1875495893379584:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612531.268755:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612531.268763:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41c4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd967 expref: 17 pid: 5853 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.268778:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd967 expref: 17 pid: 5853 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.268804:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41c4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd967 expref: 17 pid: 5853 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.269087:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e838cef00) 00010000:00010000:3.0:1788612531.269093:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.269103:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.269111:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.269146:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612531.269265:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269274:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269286:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269292:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269298:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269311:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612531.269316:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269324:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269334:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e838cef00) 00010000:00010000:0.0:1788612531.269336:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612531.269340:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269346:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41d0b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269356:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af41cfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269361:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af41cfd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269366:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af41cfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269371:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612531.269374:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af41cfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269379:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af41cfd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269397:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e838cef00) 00010000:00010000:0.0:1788612531.269399:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788612531.269402:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af41cfd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.269407:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af41cfd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612531.269885:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:2356:x1875495893379584:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 1143us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612531.269893:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00000040:00080000:2.0:1788612531.270126:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788612531.270131:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612531.270156:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788612531.270163:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788612531.271457:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:10439:x1875495893379328:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 21100us (21631us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788612531.271469:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 83 00000020:00080000:2.0:1788612531.271474:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788612531.274609:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612531.274681:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893379840 00000100:00100000:3.0:1788612531.274745:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893379840 00000100:00100000:3.0:1788612531.274991:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:3.0:1788612531.275004:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:10439:x1875495893379840:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788612531.276345:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788612531.276593:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788612531.276651:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.276669:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.276681:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.276770:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d12 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.276777:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d12 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.276783:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612531.276986:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788612531.277097:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:10439:x1875495893379840:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 2093us (2494us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788612531.277106:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000020:00080000:3.0:1788612531.277111:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788612531.279774:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612531.279791:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.279801:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0076000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612531.279806:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.279817:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.280156:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:0.0:1788612531.280161:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788612531.280166:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d12 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612531.280172:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612531.280427:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612531.280430:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612531.280432:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612531.820023:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788612532.333698:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788612532.333723:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612532.333821:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788612532.333830:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788612532.845749:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788612533.063120:0:12055:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788612533.063129:0:12055:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612533.063163:0:12055:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788612533.063170:0:12055:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788612533.222055:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612533.222146:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893380096 00000100:00100000:2.0:1788612533.222157:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893380096 00000100:00080000:3.0:1788612533.222207:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612533.222232:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:2.0:1788612533.222242:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:10457:x1875495893380096:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612533.222274:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612533.222294:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41d19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd99f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.222387:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41d20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.222399:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41d20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.222409:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41d20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612533.222417:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788612533.222513:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41d19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd99f expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.222525:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41d20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd99f expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.222531:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:2.0:1788612533.222533:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788612533.222536:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9800, rc 0) 00000100:00100000:2.0:1788612533.222586:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:10457:x1875495893380096:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 346us (542us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788612533.222593:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:3.0:1788612533.225538:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612533.228477:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893380224 00000100:00100000:2.0:1788612533.228492:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893380224 00000100:00100000:2.0:1788612533.228552:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:2.0:1788612533.228574:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:10457:x1875495893380224:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:2.0:1788612533.234434:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.234459:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.234473:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.234565:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.234574:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.234582:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.234830:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41d3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.234867:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.234875:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612533.234931:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.234945:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.234958:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.234965:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.234972:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612533.234977:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.234985:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.234998:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:2.0:1788612533.235001:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612533.235006:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235013:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235024:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235031:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235037:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235042:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612533.235051:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235058:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235066:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e9231dd00) 00010000:00010000:2.0:1788612533.235069:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612533.235072:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235077:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235095:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235101:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41d3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235107:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235112:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612533.235116:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235121:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41d3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235128:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e9231d300) 00010000:00010000:2.0:1788612533.235131:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612533.235139:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41d3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.235145:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41d3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612533.235239:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:10457:x1875495893380224:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 6663us (9704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612533.235249:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:3.0:1788612533.286353:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612533.286426:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893380480 00000100:00100000:2.0:1788612533.286438:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893380480 00000100:00100000:2.0:1788612533.286521:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:2.0:1788612533.286533:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:10460:x1875495893380480:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612533.286556:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612533.286578:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41d43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd9a6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.286655:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d4a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.286670:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.286683:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.286698:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.286705:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.286732:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287105:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41d58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287115:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41d58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287123:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41d58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612533.287133:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788612533.287231:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287238:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d4a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287251:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287257:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612533.287262:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287269:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287280:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:3.0:1788612533.287283:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612533.287287:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287291:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287300:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287303:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287307:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287310:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612533.287312:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287324:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287333:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e9231d600) 00010000:00010000:3.0:1788612533.287335:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612533.287337:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287343:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41d51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287385:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41d43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9a6 expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287396:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41d58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9a6 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.287401:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbca00) 00010000:00010000:3.0:1788612533.287402:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612533.287404:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077a00, rc 0) 00000100:00100000:3.0:1788612533.287464:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:10460:x1875495893380480:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 934us (1122us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788612533.287471:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:2.0:1788612533.290361:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612533.295969:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893380608 00000100:00100000:3.0:1788612533.295990:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893380608 00000100:00100000:3.0:1788612533.299193:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:3.0:1788612533.299209:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:10460:x1875495893380608:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:3.0:1788612533.299294:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41d66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.299313:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.299325:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.299350:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.299358:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41d66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.299365:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.299371:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612533.299376:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.299384:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41d66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.299395:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbca00) 00010000:00010000:3.0:1788612533.299398:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788612533.299402:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41d66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.299408:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41d66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612533.299521:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:10460:x1875495893380608:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 315us (9170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612533.299529:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:3.0:1788612533.304240:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612533.305127:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893380864 00000100:00100000:3.0:1788612533.305143:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893380864 00000100:00100000:3.0:1788612533.305213:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:3.0:1788612533.305224:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e8347fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:10460:x1875495893380864:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1788612533.306680:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e8347fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+22:10460:x1875495893380864:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 1450us (2438us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788612533.306693:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:3.0:1788612533.335897:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612533.336077:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893381120 00000100:00100000:2.0:1788612533.336087:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893381120 00000100:00100000:2.0:1788612533.336150:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:2.0:1788612533.336161:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+22:9981:x1875495893381120:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1788612533.336185:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612533.336206:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41d6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd9ad expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.336304:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.336320:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41d58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9a6 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.336328:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.336361:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41d58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9a6 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.336375:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41d58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9a6 expref: 23 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612533.336390:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0759880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914371840:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612533.336503:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788612533.339270:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612533.340172:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893381248 00000100:00100000:3.0:1788612533.340183:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893381248 00010000:00010000:3.0:1788612533.340229:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41d58 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9a6 expref: 24 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612533.340274:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:3.0:1788612533.340283:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+24:2355:x1875495893381248:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612533.340297:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612533.340304:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41d58 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9a6 expref: 24 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.340317:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41d58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9a6 expref: 24 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.340351:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbca00) 00010000:00010000:3.0:1788612533.340356:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.340365:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.340374:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.340393:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612533.340449:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+24:2355:x1875495893381248:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 165us (1187us total) trans 0 rc 0/0 00010000:00010000:0.0:1788612533.340586:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41d58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9a6 expref: 24 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612533.340604:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0759880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914371840:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612533.340632:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.340641:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.340647:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612533.340666:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788612533.340811:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41d6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9ad expref: 25 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612533.341556:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00010000:00010000:0.0:1788612533.342362:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9ad expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.342377:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbca00) 00010000:00010000:0.0:1788612533.342380:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788612533.342384:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9e00, rc 0) 00000100:00100000:0.0:1788612533.342438:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+23:9981:x1875495893381120:12345-192.168.202.6@tcp:101:bash.0 Request processed in 6278us (6553us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788612533.342446:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:3.0:1788612533.350800:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612533.351025:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893381504 00000100:00100000:0.0:1788612533.351036:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893381504 00000100:00100000:0.0:1788612533.351096:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:0.0:1788612533.351107:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+23:9981:x1875495893381504:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:0.0:1788612533.351530:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af41d82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.351569:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af41d82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.351583:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af41d82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612533.351642:0:8316:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788612533.351670:0:8316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096486b6e reply state 000000005c846808 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af41d82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612533.351679:0:8316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788612533.351759:0:8316:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788612533.352184:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+27:9981:x1875495893381504:12345-192.168.202.6@tcp:36:bash.0 Request processed in 1076us (1392us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788612533.352202:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 89 00000020:00080000:0.0:1788612533.352207:0:8316:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788612533.355991:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af41d82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.356010:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af41d82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.356017:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af41d82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.356023:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612533.356028:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af41d82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.356037:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af41d82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.356076:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbca00) 00010000:00010000:3.0:1788612533.356079:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612533.356085:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af41d82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.356092:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af41d82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612533.356697:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612533.356783:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893381632 00000100:00100000:3.0:1788612533.356793:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893381632 00000100:00100000:3.0:1788612533.356942:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 90 00000100:00100000:3.0:1788612533.356954:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec075bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+26:9981:x1875495893381632:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1788612533.356978:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612533.356999:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd9b4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.357063:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9b4 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.357078:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9b4 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.357099:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbca00) 00010000:00010000:3.0:1788612533.357101:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612533.357104:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0076000, rc 0) 00000100:00100000:3.0:1788612533.357169:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec075bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+27:9981:x1875495893381632:12345-192.168.202.6@tcp:101:bash.0 Request processed in 215us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612533.357176:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 90 00000100:00100000:0.0:1788612533.364115:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612533.364203:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893381760 00000100:00100000:1.0:1788612533.364214:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893381760 00000100:00100000:1.0:1788612533.364291:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:1.0:1788612533.364303:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:9981:x1875495893381760:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1788612533.364321:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612533.364346:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af41d90 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd9bb expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788612533.364373:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c0fb1, atime: 0x6a9c0fb0, ctime: 0x6a9c0fb1, blocks: 0xb 00010000:00010000:1.0:1788612533.364396:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:1.0:1788612533.364401:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612533.364409:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af41d90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9bb expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.364430:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af41d90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9bb expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.364445:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60000, rc 0) 00000100:00100000:1.0:1788612533.364519:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:9981:x1875495893381760:12345-192.168.202.6@tcp:101:bash.0 Request processed in 218us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612533.364526:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00080000:3.0:1788612533.364704:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612533.368078:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612533.368163:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893381888 00000100:00100000:0.0:1788612533.368174:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893381888 00002000:00010000:0.0:1788612533.368215:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1788612533.368219:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928ec034e300 with x1875495893381888 ext(0->18446744073709551615) 00002000:00010000:0.0:1788612533.368231:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928ec034e300. 00000100:00100000:0.0:1788612533.368264:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:0.0:1788612533.368275:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2354:x1875495893381888:12345-192.168.202.6@tcp:10:bash.0 00002000:00010000:0.0:1788612533.368539:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788612533.368543:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788612529 -> 1788612533 00002000:00010000:0.0:1788612533.368546:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788612528 -> 1788612528 00002000:00010000:0.0:1788612533.368548:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788612529 -> 1788612533 00002000:00010000:0.0:1788612533.368563:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788612533.368755:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2354:x1875495893381888:12345-192.168.202.6@tcp:10:bash.0 Request processed in 480us (685us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788612533.368764:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00002000:00010000:0.0:1788612533.368768:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1788612533.368771:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928ec034e300 with x1875495893381888 ext(0->18446744073709551615) 00002000:00010000:0.0:1788612533.368776:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928ec034e300. 00000001:00080000:3.0:1788612533.397982:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1788612533.398002:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1788612533.460047:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612533.460288:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893382016 00000100:00100000:2.0:1788612533.460297:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893382016 00000100:00100000:2.0:1788612533.460352:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:2.0:1788612533.460374:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+27:10474:x1875495893382016:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:2.0:1788612533.460449:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d97 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460464:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460476:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460492:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41d9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460500:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460507:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460702:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41da5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460709:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460713:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612533.460750:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460758:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460762:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460767:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460770:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612533.460773:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460778:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460785:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:2.0:1788612533.460787:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612533.460790:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460794:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41d97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460803:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460806:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41d9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460814:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460817:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612533.460819:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460822:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41d9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460827:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e9231d300) 00010000:00010000:2.0:1788612533.460829:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612533.460831:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41d9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460906:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41d9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460924:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460929:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41da5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460934:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460939:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612533.460941:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460957:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41da5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460970:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbca00) 00010000:00010000:2.0:1788612533.460972:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612533.460975:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41da5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.460980:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41da5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612533.461047:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+27:10474:x1875495893382016:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 675us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612533.461055:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:3.0:1788612533.498131:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612533.498182:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893382272 00000100:00100000:2.0:1788612533.498195:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893382272 00000100:00100000:2.0:1788612533.498260:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:2.0:1788612533.498271:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+27:10477:x1875495893382272:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612533.498293:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612533.498315:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41dac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd9c2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.498806:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41db3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.498818:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41db3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.498828:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41db3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.498913:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41dba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.498920:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.498927:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.499174:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41dc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.499181:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.499185:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612533.499192:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788612533.499279:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41db3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.499285:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41db3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.499289:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41db3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.499293:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612533.499296:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41db3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.499309:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41db3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.503213:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:2.0:1788612533.503223:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612533.503234:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41db3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.503245:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41db3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.503269:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.503276:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41dba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.503282:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.503287:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612533.503291:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.503299:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41dba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.503314:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e9231d300) 00010000:00010000:2.0:1788612533.503372:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612533.503376:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41dba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.503401:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41dba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.503460:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41dac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9c2 expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.503475:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9c2 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.503482:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbca00) 00010000:00010000:2.0:1788612533.503484:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788612533.503487:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8600, rc 0) 00000100:00100000:2.0:1788612533.503551:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+29:10477:x1875495893382272:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 5282us (5431us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788612533.503558:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:1.0:1788612533.506084:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612533.506162:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893382400 00000100:00100000:2.0:1788612533.506172:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893382400 00000100:00100000:2.0:1788612533.506236:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 93 00000100:00100000:2.0:1788612533.506246:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+29:10477:x1875495893382400:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:2.0:1788612533.506316:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.506344:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9ad expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.506354:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.506408:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9ad expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.506423:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9ad expref: 29 pid: 5854 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612533.506437:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0759180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914371968:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612533.506553:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788612533.509443:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612533.509587:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0759180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914371968:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612533.509613:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612533.509686:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893382656 00000100:00100000:1.0:1788612533.509694:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893382656 00000100:00100000:1.0:1788612533.509755:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:1.0:1788612533.509766:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+30:5594:x1875495893382656:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788612533.510148:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+31:5594:x1875495893382656:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 383us (713us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788612533.510156:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:3.0:1788612533.512494:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612533.512589:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893382784 00000100:00100000:0.0:1788612533.512598:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893382784 00010000:00010000:0.0:1788612533.512639:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9ad expref: 31 pid: 5854 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612533.512680:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:0.0:1788612533.512690:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+31:2356:x1875495893382784:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612533.512703:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612533.512710:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9ad expref: 31 pid: 5854 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.512724:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9ad expref: 31 pid: 5854 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.512745:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41d74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9ad expref: 31 pid: 5854 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.512761:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbca00) 00010000:00010000:0.0:1788612533.512766:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.512792:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.512799:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.512894:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612533.512944:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+30:2356:x1875495893382784:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 255us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612533.512951:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00010000:00010000:2.0:1788612533.513021:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.513030:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.513058:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.513067:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.513074:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.513080:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612533.513084:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.513100:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.513109:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbca00) 00010000:00010000:2.0:1788612533.513112:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612533.513116:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.513122:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41dcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612533.513162:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+29:10477:x1875495893382400:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 6918us (7091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612533.513170:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 93 00000100:00100000:2.0:1788612533.515911:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612533.515992:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893383040 00000100:00100000:1.0:1788612533.516002:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893383040 00000100:00100000:1.0:1788612533.516058:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:1.0:1788612533.516068:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+29:10477:x1875495893383040:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1788612533.516313:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+30:10477:x1875495893383040:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 245us (412us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788612533.516320:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:3.0:1788612533.598042:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612533.598344:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893383296 00000100:00100000:0.0:1788612533.598355:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893383296 00000100:00100000:0.0:1788612533.598420:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 94 00000100:00100000:0.0:1788612533.598432:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+30:10488:x1875495893383296:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:0.0:1788612533.598470:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612533.598493:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af41dd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd9c9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.598568:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41ddd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.598585:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41ddd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.598598:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41ddd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.598614:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41de4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.598641:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.598649:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.598975:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41deb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.598985:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.598993:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612533.599002:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788612533.599101:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41ddd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599110:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41ddd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599116:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41ddd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599123:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdfe00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612533.599127:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41ddd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599136:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41ddd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599159:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:0.0:1788612533.599162:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612533.599167:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41ddd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599174:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41ddd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599188:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599208:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41de4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599215:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599220:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdfa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612533.599224:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599230:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41de4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599238:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e91fbbc00) 00010000:00010000:0.0:1788612533.599240:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612533.599243:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41de4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599249:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41de4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599303:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af41dd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9c9 expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599319:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9c9 expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.599327:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbca00) 00010000:00010000:0.0:1788612533.599329:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612533.599332:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf600, rc 0) 00000100:00100000:0.0:1788612533.599402:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+32:10488:x1875495893383296:12345-192.168.202.6@tcp:101:cat.0 Request processed in 972us (1370us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788612533.599410:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 94 00000100:00100000:0.0:1788612533.603717:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612533.603792:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893383552 00000100:00100000:3.0:1788612533.603801:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893383552 00000100:00100000:3.0:1788612533.603901:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:3.0:1788612533.603912:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+32:10488:x1875495893383552:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:3.0:1788612533.604169:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+33:10488:x1875495893383552:12345-192.168.202.6@tcp:35:cat.0 Request processed in 257us (460us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788612533.604177:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:2.0:1788612533.629060:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612533.629162:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893383808 00000100:00100000:0.0:1788612533.629173:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893383808 00000100:00100000:0.0:1788612533.629247:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 95 00000100:00100000:0.0:1788612533.629259:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec075b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+33:10489:x1875495893383808:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:0.0:1788612533.629326:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788612533.629368:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41deb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9c9 expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.629394:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41dc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9c2 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.629410:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41d89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9b4 expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.629447:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928ea7bbca00) 00010000:00010000:0.0:1788612533.629473:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612533.629497:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af41df9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.629514:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af41df9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.629524:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af41df9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.629542:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41e00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.629550:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.629557:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.629813:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41e07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.629823:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41e07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.629830:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41e07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788612533.630491:0:8316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1788612533.630504:0:8316:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 327473665485ns, next at 328473662317ns, rc = 0 00010000:00010000:0.0:1788612533.630578:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41e0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630590:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41e0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630599:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41e0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630606:0:8316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41e0e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630613:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41e0e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630620:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41e0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630640:0:8316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612533.630660:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41e07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630666:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41e07 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630672:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41e07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630677:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdfe00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612533.630682:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41e07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630690:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41e07 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630708:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb300) 00010000:00010000:0.0:1788612533.630711:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788612533.630716:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41e07 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630723:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41e07 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630742:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af41df9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630749:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af41df9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630754:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af41df9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630759:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612533.630761:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af41df9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630767:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af41df9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630774:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:0.0:1788612533.630777:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612533.630779:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af41df9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.630785:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af41df9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788612533.630807:0:8316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005cf50efa reply state 000000006ac6216d transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612533.630815:0:8316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612533.630950:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec075b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+32:10489:x1875495893383808:12345-192.168.202.6@tcp:36:rm.0 Request processed in 1690us (1898us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788612533.630959:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 95 00010000:00010000:3.0:1788612533.631531:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612533.631540:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41e0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.631548:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612533.631552:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41e0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.631560:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41e0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.631573:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff928e91fbb300) 00010000:00010000:3.0:1788612533.631576:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788612533.631580:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41e0e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.631594:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af41e0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.631611:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612533.631613:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612533.631615:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612533.634596:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.634617:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41e00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.634625:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41e00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.634632:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdfa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612533.634637:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41e00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.634665:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41e00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.634683:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e91fbbc00) 00010000:00010000:1.0:1788612533.634685:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612533.634690:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41e00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.634697:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af41e00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612533.683670:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612533.684053:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893384064 00000100:00100000:3.0:1788612533.684064:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893384064 00000100:00100000:3.0:1788612533.684129:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:3.0:1788612533.684141:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+31:10495:x1875495893384064:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1788612533.684166:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612533.684188:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41e15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd9d0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.684318:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.684342:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.684353:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.684369:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41e23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.684377:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.684383:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788612533.684961:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788612533.685109:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41e2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.685120:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.685127:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.685156:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.685162:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e1c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.685168:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.685175:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0076800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612533.685179:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.685186:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.685197:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:3.0:1788612533.685200:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612533.685203:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.685219:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612533.685234:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012b155b2 reply state 00000000122f6dce transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612533.685241:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788612533.685269:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af41e15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d0 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.685283:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d0 expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.685289:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928ea7bbc300) 00010000:00010000:3.0:1788612533.685292:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612533.685294:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077a00, rc 0) 00000100:00100000:3.0:1788612533.685380:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+34:10495:x1875495893384064:12345-192.168.202.6@tcp:101:bash.0 Request processed in 1241us (1720us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788612533.685388:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 96 00010000:00010000:3.0:1788612533.687815:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.687926:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41e23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.687933:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.687938:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0076000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612533.687958:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.687966:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41e23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.687982:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928ea7bbc900) 00010000:00010000:3.0:1788612533.687986:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612533.687990:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41e23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.687997:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41e23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612533.691245:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612533.691983:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893384192 00000100:00100000:3.0:1788612533.691996:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893384192 00000100:00100000:3.0:1788612533.692080:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:3.0:1788612533.692092:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2356:x1875495893384192:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1788612533.692109:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612533.692134:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d82e72ea/0xfc956d548af41e38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd9d7 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612533.692164:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788612533.692184:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:3.0:1788612533.692189:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00080000:2.0:1788612533.692567:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788612533.692600:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d82e72ea/0xfc956d548af41e38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d7 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.692626:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d82e72ea/0xfc956d548af41e38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d7 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.692655:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077200, rc 0) 00000100:00100000:3.0:1788612533.692722:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893384192:12345-192.168.202.6@tcp:101:bash.0 Request processed in 632us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612533.692730:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:0.0:1788612533.696818:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612533.696998:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893384320 00000100:00100000:1.0:1788612533.697009:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893384320 00000100:00100000:1.0:1788612533.697068:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:1.0:1788612533.697078:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:10495:x1875495893384320:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1788612533.697096:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612533.697114:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd9de expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.697145:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d82e72ea/0xfc956d548af41e38 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d7 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.697154:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612533.697158:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612533.697163:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.697194:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d82e72ea/0xfc956d548af41e38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d7 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.697235:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d82e72ea/0xfc956d548af41e38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d7 expref: 7 pid: 6697 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612533.697250:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec034ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875495914372096:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612533.697329:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e829dca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612533.700888:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612533.700968:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893384448 00000100:00100000:3.0:1788612533.700977:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893384448 00010000:00010000:3.0:1788612533.701019:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d82e72ea/0xfc956d548af41e38 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d7 expref: 8 pid: 6697 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612533.701063:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:3.0:1788612533.701075:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9238c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2355:x1875495893384448:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612533.701089:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612533.701113:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d82e72ea/0xfc956d548af41e38 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d7 expref: 8 pid: 6697 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.701128:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d82e72ea/0xfc956d548af41e38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d7 expref: 8 pid: 6697 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.701156:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612533.701161:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612533.701170:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.701181:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.701247:0:11669:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612533.701261:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc3e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11669:1875495914372224:192.168.202.6@tcp:105: 00000100:00100000:3.0:1788612533.701355:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340ee40 going to sleep for 11 seconds 00010000:00010000:0.0:1788612533.702059:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d82e72ea/0xfc956d548af41e38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d7 expref: 8 pid: 6697 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612533.702079:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec034ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875495914372096:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612533.702107:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.702120:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60400, rc 0) 00000100:00100000:0.0:1788612533.702172:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:10495:x1875495893384320:12345-192.168.202.6@tcp:101:bash.0 Request processed in 5095us (5365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612533.702180:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:3.0:1788612533.707615:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc3e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11669:1875495914372224:192.168.202.6@tcp:105: 00010000:00010000:3.0:1788612533.707647:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612533.707714:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9238c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893384448:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 6640us (6836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612533.707725:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:2.0:1788612533.717680:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612533.717885:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893384704 00000100:00100000:3.0:1788612533.717896:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893384704 00000100:00100000:3.0:1788612533.717957:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:3.0:1788612533.717970:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+33:10495:x1875495893384704:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:3.0:1788612533.718315:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+34:10495:x1875495893384704:12345-192.168.202.6@tcp:35:bash.0 Request processed in 347us (646us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788612533.718325:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00010000:00010000:1.0:1788612533.868149:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612533.885943:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612533.886022:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893384832 00000100:00100000:0.0:1788612533.886034:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893384832 00000100:00100000:0.0:1788612533.886099:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:0.0:1788612533.886111:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+34:10511:x1875495893384832:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1788612533.886134:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612533.886156:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41e46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd9e5 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.886256:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41e4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.886272:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.886284:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612533.886320:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788612533.886323:0:8316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612533.886341:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.886367:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfe00/0xfc956d548af41e46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9e5 expref: 36 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.886386:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9e5 expref: 35 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.886395:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:0.0:1788612533.886397:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612533.886401:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf600, rc 0) 00000100:00100000:0.0:1788612533.886476:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+35:10511:x1875495893384832:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 367us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612533.886483:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:0.0:1788612533.891539:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612533.891619:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893385088 00000100:00100000:3.0:1788612533.891630:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893385088 00000100:00100000:3.0:1788612533.891698:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 98 00000100:00100000:3.0:1788612533.891709:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+35:10511:x1875495893385088:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612533.891730:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612533.891752:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41e54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd9ec expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.891940:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.891954:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.891965:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612533.891976:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788612533.892101:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41e54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9ec expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.892121:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9ec expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.892129:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928ea7bbc300) 00010000:00010000:3.0:1788612533.892132:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612533.892136:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0076800, rc 0) 00000100:00100000:3.0:1788612533.892195:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+37:10511:x1875495893385088:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 487us (664us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788612533.892202:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 98 00000100:00100000:1.0:1788612533.896207:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612533.896273:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893385344 00000100:00100000:0.0:1788612533.896294:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893385344 00000100:00100000:0.0:1788612533.896348:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 99 00000100:00100000:0.0:1788612533.896356:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+37:10511:x1875495893385344:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1788612533.896379:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612533.896398:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41e69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd9f3 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.896501:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.896515:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.896526:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612533.896538:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788612533.896651:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41e69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9f3 expref: 40 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.896670:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9f3 expref: 39 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.896678:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928ea7bbc300) 00010000:00010000:0.0:1788612533.896681:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788612533.896684:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdee00, rc 0) 00000100:00100000:0.0:1788612533.896747:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+39:10511:x1875495893385344:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 391us (558us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788612533.896754:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 99 00000100:00100000:2.0:1788612533.899962:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612533.900079:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893385472 00000100:00100000:0.0:1788612533.900088:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893385472 00000100:00100000:0.0:1788612533.900154:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:0.0:1788612533.900164:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0997480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+39:2354:x1875495893385472:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612533.900179:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612533.900217:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af41e5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9ec expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.900238:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928ea7bbc300) 00010000:00010000:0.0:1788612533.900243:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612533.900297:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0997480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+38:2354:x1875495893385472:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 133us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612533.900305:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:1.0:1788612533.905773:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612533.905892:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893385600 00000100:00100000:0.0:1788612533.905903:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893385600 00000100:00100000:0.0:1788612533.905963:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:0.0:1788612533.905974:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2354:x1875495893385600:12345-192.168.202.6@tcp:1:lfs.0 00010000:00010000:0.0:1788612533.906018:0:8463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af41e7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.906039:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.906048:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612533.906052:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612533.906057:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af41e7e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.906116:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.906131:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 6 pid: 6698 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612533.906147:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec082aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1875495914372352:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612533.906236:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e86211300 going to sleep for 11 seconds 00000100:00100000:1.0:1788612533.909379:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612533.909484:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec082aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8463:1875495914372352:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612533.909512:0:8463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af41e7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612533.909628:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893385728 00000100:00100000:3.0:1788612533.909635:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893385728 00002000:00100000:3.0:1788612533.909687:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff928ec034df80 x1875495893385728/t0(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:179/0 lens 504/0 e 0 to 0 dl 1788612544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612533.909697:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928ec034df80 with x1875495893385728 ext(0->8) 00010000:00010000:3.0:1788612533.909718:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 7 pid: 6698 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.909732:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 7 pid: 6698 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612533.909739:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff928ec034df80 00000100:00100000:3.0:1788612533.909773:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:3.0:1788612533.909783:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2356:x1875495893385728:12345-192.168.202.6@tcp:4:lfs.0 00000100:00100000:3.0:1788612533.910326:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2356:x1875495893385728:12345-192.168.202.6@tcp:4:lfs.0 Request processed in 543us (955us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788612533.910335:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00002000:00100000:3.0:1788612533.910343:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff928ec034df80 x1875495893385728/t4294967302(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:179/0 lens 504/448 e 0 to 0 dl 1788612544 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612533.910352:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928ec034df80 with x1875495893385728 ext(0->8) 00010000:00010000:3.0:1788612533.910358:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 9 pid: 6698 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.910369:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 9 pid: 6698 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612533.910375:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff928ec034df80 00000100:00100000:2.0:1788612533.913138:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612533.913233:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893385856 00000100:00100000:1.0:1788612533.913244:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893385856 00010000:00010000:1.0:1788612533.913286:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 9 pid: 6698 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612533.913332:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:1.0:1788612533.913342:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0995c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2353:x1875495893385856:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612533.913358:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788612533.913380:0:5838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788612533.913383:0:5838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788612534 00002000:00010000:1.0:1788612533.913385:0:5838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788612534 00002000:00010000:1.0:1788612533.913387:0:5838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788612534 00010000:00010000:1.0:1788612533.913394:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 9 pid: 6698 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.913430:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 9 pid: 6698 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.913455:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000917e6c00/0xfc956d548af41e3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9de expref: 9 pid: 6698 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.913488:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612533.913492:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612533.913499:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af41e7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.913509:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af41e7e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.913548:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612533.913614:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0995c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2353:x1875495893385856:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 272us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612533.913621:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 50 00010000:00010000:0.0:1788612533.913745:0:8463:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af41e7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.913755:0:8463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af41e7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.913780:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af41e7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.913788:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af41e7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.913807:0:8463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af41e7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.913814:0:8463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612533.913818:0:8463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af41e7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.913826:0:8463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af41e7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.913888:0:8463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af41e7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.913897:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af41e7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612533.913948:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2354:x1875495893385600:12345-192.168.202.6@tcp:1:lfs.0 Request processed in 7977us (8187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612533.913955:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:0.0:1788612533.916701:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612533.916777:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893386112 00000100:00100000:1.0:1788612533.916787:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893386112 00000100:00100000:1.0:1788612533.916885:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:1.0:1788612533.916894:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e8347d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+38:10511:x1875495893386112:12345-192.168.202.6@tcp:35:lfs.0 00000004:00010000:1.0:1788612533.916963:0:5856:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9f3 expref: 38 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788612533.917280:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788612533.917328:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788612533.917643:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788612533.917701:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.917717:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41e2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d0 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.917726:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.917762:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d0 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.917777:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41e2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d0 expref: 42 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612533.917791:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec034fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5856:1875495914372480:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612533.917923:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612533.921227:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612533.921305:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893386240 00000100:00100000:3.0:1788612533.921315:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893386240 00010000:00010000:3.0:1788612533.921359:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41e2a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d0 expref: 43 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612533.921428:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:3.0:1788612533.921439:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+43:2355:x1875495893386240:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612533.921455:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612533.921468:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41e2a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d0 expref: 43 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.921483:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41e2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d0 expref: 43 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.921507:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928ea7bbc300) 00010000:00010000:3.0:1788612533.921512:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.921522:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.921529:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612533.921549:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612533.921610:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+43:2355:x1875495893386240:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 171us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612533.921618:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00010000:00010000:1.0:1788612533.922287:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41e2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9d0 expref: 42 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612533.922306:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec034fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5856:1875495914372480:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612533.922330:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.922354:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612533.922360:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788612533.922500:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788612533.922712:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788612533.924009:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec034fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1875495914372608:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788612533.924081:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612533.924166:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612533.924433:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914372608 00000100:00100000:2.0:1788612533.924440:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914372608 00000100:00100000:2.0:1788612533.924618:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788612533.924628:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1875495914372608:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788612533.924728:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1875495914372608:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 101us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612533.924749:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788612533.924875:0:5856:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788612533.924882:0:5856:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1788612533.924903:0:5856:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff928eacd2dc00, transno 4294967301 00000100:00100000:0.0:1788612533.924926:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec034fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1875495914372608:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788612533.925438:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788612533.925528:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0829500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1875495914372736:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788612533.925577:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612533.925596:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacc40900 going to sleep for 11 seconds 00000100:00100000:2.0:1788612533.925942:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914372736 00000100:00100000:2.0:1788612533.925949:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914372736 00000100:00100000:2.0:1788612533.925978:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788612533.925985:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1875495914372736:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788612533.926136:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5856:x1875495914372736:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 151us (558us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788612533.926143:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788612533.926552:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0829500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1875495914372736:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788612533.926610:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788612533.926652:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.926662:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.926670:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.926675:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612533.926679:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.926687:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.926703:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928ea7bbc300) 00010000:00010000:0.0:1788612533.926706:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788612533.926711:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612533.926717:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41e85 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788612533.927398:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788612533.927571:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1788612533.927584:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 327770746103ns, next at 328770743645ns, rc = 0 00000001:00080000:0.0:1788612533.927591:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788612533.927632:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928ea7bbc300) 00010000:00010000:0.0:1788612533.927636:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788612533.927645:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9f3 expref: 46 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612533.927814:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e8347d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+45:10511:x1875495893386112:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 10919us (11121us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788612533.927824:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000020:00080000:0.0:1788612533.927870:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1788612533.928130:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612533.930802:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612533.931270:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893386368 00000100:00100000:3.0:1788612533.931282:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893386368 00000100:00100000:2.0:1788612533.931463:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 100 00000100:00100000:2.0:1788612533.931475:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+45:10511:x1875495893386368:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612533.931502:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612533.931528:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41e8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dd9fa expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.931592:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41e8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9fa expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.931608:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41e8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9fa expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612533.931629:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:2.0:1788612533.931632:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788612533.931636:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8600, rc 0) 00000100:00100000:2.0:1788612533.931704:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+46:10511:x1875495893386368:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 230us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612533.931712:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 100 00000100:00100000:3.0:1788612533.934416:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612533.934571:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893386624 00000100:00100000:1.0:1788612533.934581:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893386624 00000100:00100000:1.0:1788612533.934644:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:1.0:1788612533.934654:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+46:10511:x1875495893386624:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1788612533.934928:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+47:10511:x1875495893386624:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 274us (523us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788612533.934937:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:3.0:1788612534.039737:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612534.040028:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893386752 00000100:00100000:0.0:1788612534.040038:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893386752 00000100:00100000:0.0:1788612534.040108:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00100000:0.0:1788612534.040119:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+47:10521:x1875495893386752:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:0.0:1788612534.040198:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e93 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040228:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040241:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040259:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41e9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040267:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41e9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040290:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41e9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040383:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ea1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040391:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040398:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788612534.040440:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040465:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040472:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040478:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040484:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdee00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612534.040490:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040498:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040519:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:0.0:1788612534.040529:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612534.040535:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040542:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41e93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040559:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41e9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040565:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41e9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040571:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41e9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040576:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612534.040579:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41e9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040585:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41e9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040593:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e91fbb100) 00010000:00010000:0.0:1788612534.040596:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612534.040598:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41e9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040604:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41e9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040619:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040630:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ea1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040636:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040640:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612534.040643:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040649:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ea1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040656:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:0.0:1788612534.040658:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612534.040661:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ea1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.040666:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ea1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612534.040752:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+47:10521:x1875495893386752:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 634us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612534.040760:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00100000:1.0:1788612534.091395:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612534.091508:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893387008 00000100:00100000:0.0:1788612534.091527:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893387008 00000100:00100000:0.0:1788612534.091592:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 102 00000100:00100000:0.0:1788612534.091604:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+47:10524:x1875495893387008:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1788612534.091628:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612534.091662:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ea8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda01 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.091737:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41eaf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.091752:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.091763:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.091777:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41eb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.091784:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.091790:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092161:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ebd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092171:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092178:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612534.092188:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788612534.092303:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092324:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41eaf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092331:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41eaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092337:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612534.092341:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41eaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092349:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41eaf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092361:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:0.0:1788612534.092364:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612534.092369:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41eaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092375:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41eaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092390:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092395:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41eb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092401:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092407:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdee00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612534.092416:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092423:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092431:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e91fbb100) 00010000:00010000:0.0:1788612534.092433:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612534.092436:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41eb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092442:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41eb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092484:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ea8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda01 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092499:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda01 expref: 49 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.092515:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:0.0:1788612534.092518:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612534.092521:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdfc00, rc 0) 00000100:00100000:0.0:1788612534.092596:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+49:10524:x1875495893387008:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 993us (1210us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788612534.092604:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 102 00000100:00100000:3.0:1788612534.096809:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612534.097057:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893387136 00000100:00100000:0.0:1788612534.097069:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893387136 00000100:00100000:0.0:1788612534.097136:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 103 00000100:00100000:0.0:1788612534.097147:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+49:10524:x1875495893387136:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:0.0:1788612534.097242:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ecb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.097260:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.097272:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.097298:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.097305:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ecb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.097312:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.097318:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612534.097322:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.097330:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ecb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.097341:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:0.0:1788612534.097344:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612534.097349:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ecb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.097356:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ecb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612534.097443:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+49:10524:x1875495893387136:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 297us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612534.097451:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 103 00000100:00100000:3.0:1788612534.100186:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612534.100293:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893387392 00000100:00100000:1.0:1788612534.100301:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893387392 00000100:00100000:1.0:1788612534.100355:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:1.0:1788612534.100365:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+49:10524:x1875495893387392:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1788612534.100630:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+50:10524:x1875495893387392:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 265us (453us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788612534.100637:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:1.0:1788612534.182153:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612534.182273:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893387648 00000100:00100000:2.0:1788612534.182285:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893387648 00000100:00100000:2.0:1788612534.182362:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:2.0:1788612534.182372:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+50:10534:x1875495893387648:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1788612534.182399:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612534.182402:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788612534.182428:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41e4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9e5 expref: 50 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.182448:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:2.0:1788612534.182453:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612534.182475:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41ed2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda08 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.182586:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.182602:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ebd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda01 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.182611:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.182644:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda01 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.182658:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ebd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda01 expref: 50 pid: 5854 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612534.182691:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914372864:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612534.182785:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788612534.188563:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914372864:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612534.188596:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612534.190223:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612534.190609:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893387776 00000100:00100000:2.0:1788612534.190618:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893387776 00010000:00010000:2.0:1788612534.190661:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ebd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda01 expref: 51 pid: 5854 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612534.190703:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:2.0:1788612534.190713:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+51:2356:x1875495893387776:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612534.190727:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612534.190733:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ebd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda01 expref: 51 pid: 5854 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.190747:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda01 expref: 51 pid: 5854 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.190769:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41ebd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda01 expref: 51 pid: 5854 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.190786:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:2.0:1788612534.190792:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.190802:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.190892:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.190925:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612534.190975:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+50:2356:x1875495893387776:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 262us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612534.190982:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00010000:00010000:0.0:1788612534.191288:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.191297:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612534.191316:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788612534.191492:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41ed2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda08 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.191632:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda08 expref: 50 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.191643:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:0.0:1788612534.191646:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788612534.191649:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8e00, rc 0) 00000100:00100000:0.0:1788612534.191697:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+50:10534:x1875495893387648:12345-192.168.202.6@tcp:101:bash.0 Request processed in 9326us (9555us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788612534.191705:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:1.0:1788612534.195897:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612534.195987:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893388032 00000100:00100000:0.0:1788612534.196011:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893388032 00000100:00100000:0.0:1788612534.196071:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 105 00000100:00100000:0.0:1788612534.196082:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+50:10534:x1875495893388032:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:0.0:1788612534.196386:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ee7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.196404:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.196416:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612534.196483:0:8316:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788612534.196511:0:8316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a0f6c9f reply state 00000000732e7a3c transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612534.196520:0:8316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612534.196617:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+53:10534:x1875495893388032:12345-192.168.202.6@tcp:36:bash.0 Request processed in 535us (729us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788612534.196625:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 105 00000020:00080000:0.0:1788612534.196629:0:8316:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788612534.199685:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612534.199703:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ee7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612534.199711:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ee7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612534.199717:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612534.199722:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ee7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612534.199731:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ee7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612534.199749:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:1.0:1788612534.199752:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612534.199757:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ee7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612534.199764:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41ee7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612534.200298:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612534.202290:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893388160 00000100:00100000:0.0:1788612534.202304:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893388160 00000100:00100000:0.0:1788612534.202639:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 106 00000100:00100000:0.0:1788612534.202652:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:10534:x1875495893388160:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1788612534.202673:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612534.202694:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41eee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda0f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.202779:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.202808:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda08 expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.202817:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.202888:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda08 expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.202902:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda08 expref: 53 pid: 5852 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612534.202916:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec082b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914372992:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612534.203012:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e829dc180 going to sleep for 11 seconds 00000100:00100000:3.0:1788612534.205534:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612534.205819:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec082b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914372992:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612534.205873:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612534.205954:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893388288 00000100:00100000:1.0:1788612534.205961:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893388288 00010000:00010000:1.0:1788612534.205997:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda08 expref: 54 pid: 5852 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612534.206057:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:1.0:1788612534.206067:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:2355:x1875495893388288:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612534.206081:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612534.206088:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda08 expref: 54 pid: 5852 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612534.206101:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda08 expref: 54 pid: 5852 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612534.206123:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41ed9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda08 expref: 54 pid: 5852 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612534.206139:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:1.0:1788612534.206144:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612534.206154:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612534.206162:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612534.206182:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612534.206297:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+53:2355:x1875495893388288:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 231us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612534.206304:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00010000:00010000:3.0:1788612534.208399:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.208414:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612534.208517:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788612534.208522:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612534.208547:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.208583:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41eee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda0f expref: 53 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.208602:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda0f expref: 52 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.208611:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:3.0:1788612534.208613:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612534.208617:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf800, rc 0) 00000100:00100000:3.0:1788612534.208719:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:10534:x1875495893388160:12345-192.168.202.6@tcp:101:bash.0 Request processed in 6069us (8425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612534.208728:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 106 00000100:00100000:0.0:1788612534.212520:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612534.212616:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893388544 00000100:00100000:1.0:1788612534.212641:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893388544 00000100:00100000:1.0:1788612534.212731:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:1.0:1788612534.212743:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:10534:x1875495893388544:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:1.0:1788612534.213066:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+53:10534:x1875495893388544:12345-192.168.202.6@tcp:35:bash.0 Request processed in 323us (610us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788612534.213074:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:0.0:1788612534.316866:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914373120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612534.316940:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612534.317061:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914373120 00000100:00100000:3.0:1788612534.317070:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914373120 00000100:00100000:3.0:1788612534.317126:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788612534.317149:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875495914373120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612534.317173:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788612534.317225:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875495914373120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612534.317232:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788612534.317667:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914373120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612534.339449:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612534.339561:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893388672 00000100:00100000:2.0:1788612534.339574:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893388672 00000100:00100000:2.0:1788612534.339647:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 107 00000100:00100000:2.0:1788612534.339658:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+53:10540:x1875495893388672:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612534.339685:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612534.339708:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41efc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda16 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.339775:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41f03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.339790:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.339802:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612534.339890:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788612534.339894:0:8316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612534.339913:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.339952:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41efc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda16 expref: 55 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.340129:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41f03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda16 expref: 54 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.340140:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:2.0:1788612534.340142:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612534.340146:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9e00, rc 0) 00000100:00100000:2.0:1788612534.340213:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:10540:x1875495893388672:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 557us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612534.340221:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 107 00000100:00100000:2.0:1788612534.348752:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612534.348892:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893388800 00000100:00100000:0.0:1788612534.348903:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893388800 00000100:00100000:0.0:1788612534.348973:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 108 00000100:00100000:0.0:1788612534.348984:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:10540:x1875495893388800:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1788612534.349025:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612534.349049:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af41f0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda1d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349120:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349138:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349150:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349166:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349173:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349181:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349282:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41f1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349293:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349300:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612534.349336:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788612534.349349:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612534.349370:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349382:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349390:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349397:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349404:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349410:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612534.349415:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349422:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349434:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:0.0:1788612534.349437:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612534.349441:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349448:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349574:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349591:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349597:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349602:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdee00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612534.349605:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349610:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349619:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e91fbb100) 00010000:00010000:0.0:1788612534.349621:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612534.349624:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349629:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349664:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af41f0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda1d expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349677:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda1d expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612534.349684:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:0.0:1788612534.349686:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612534.349695:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf000, rc 0) 00000100:00100000:0.0:1788612534.349807:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:10540:x1875495893388800:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 824us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612534.349816:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 108 00000100:00100000:0.0:1788612534.359231:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612534.359317:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893389056 00000100:00100000:2.0:1788612534.359327:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893389056 00000100:00100000:2.0:1788612534.359382:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 109 00000100:00100000:2.0:1788612534.359392:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:10540:x1875495893389056:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612534.359411:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612534.359433:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41f26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda24 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.359542:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.359556:0:8316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda0f expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.359584:0:8316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41f1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda1d expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.359593:0:8316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.359624:0:8316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda1d expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.359638:0:8316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41f1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda1d expref: 56 pid: 5852 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612534.359651:0:8316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0996300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8316:1875495914373248:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612534.359760:0:8316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda0f expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.359770:0:8316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda0f expref: 56 pid: 5854 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612534.359778:0:8316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8316:1875495914373376:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612534.359801:0:8316:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612534.366536:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612534.366749:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893389184 00000100:00100000:2.0:1788612534.366762:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893389184 00010000:00010000:2.0:1788612534.366811:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41f1f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda1d expref: 57 pid: 5852 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612534.366932:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:2.0:1788612534.366943:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:2356:x1875495893389184:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612534.366959:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612534.366967:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41f1f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda1d expref: 57 pid: 5852 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.366981:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41f1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda1d expref: 57 pid: 5852 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.367004:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:2.0:1788612534.367010:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.367019:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.367026:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612534.367079:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:2356:x1875495893389184:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 138us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612534.367087:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:1.0:1788612534.373245:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:2.0:1788612534.373370:0:8316:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.6@tcp) returned -22 from blocking AST (req@000000008edf5451 x1875495914373248) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41f1f lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda1d expref: 56 pid: 5852 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.373393:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af41f1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda1d expref: 56 pid: 5852 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612534.373432:0:8316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0996300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8316:1875495914373248:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612534.373448:0:8316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8316:1875495914373376:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612534.373484:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:2.0:1788612534.373490:0:8316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.373500:0:8316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.373510:0:8316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612534.373691:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893389312 00000100:00100000:3.0:1788612534.373699:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893389312 00010000:00010000:3.0:1788612534.373737:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda0f expref: 56 pid: 5854 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612534.373779:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:3.0:1788612534.373788:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9238c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+56:2356:x1875495893389312:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612534.373802:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612534.373807:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda0f expref: 56 pid: 5854 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.373819:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda0f expref: 56 pid: 5854 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.373892:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af41ef5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda0f expref: 56 pid: 5854 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.373905:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:3.0:1788612534.373908:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.373917:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.373933:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.373957:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612534.374019:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9238c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:2356:x1875495893389312:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 230us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612534.374026:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 55 00010000:00010000:2.0:1788612534.374141:0:8316:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.374149:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612534.374170:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788612534.374332:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41f26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda24 expref: 56 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.374349:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda24 expref: 55 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.374356:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:2.0:1788612534.374359:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788612534.374369:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8e00, rc 0) 00000100:00100000:2.0:1788612534.374395:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:10540:x1875495893389056:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 15005us (15173us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788612534.374402:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 109 00000100:00100000:0.0:1788612534.378201:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612534.378291:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893389568 00000100:00100000:2.0:1788612534.378301:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893389568 00000100:00100000:2.0:1788612534.378379:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:2.0:1788612534.378390:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:10540:x1875495893389568:12345-192.168.202.6@tcp:103:lfs.0 00010000:00010000:2.0:1788612534.378404:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612534.378425:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41e8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9fa expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612534.378444:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:2.0:1788612534.378449:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612534.378517:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:10540:x1875495893389568:12345-192.168.202.6@tcp:103:lfs.0 Request processed in 129us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612534.378525:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:1.0:1788612534.385333:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612534.385489:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893389696 00000100:00100000:3.0:1788612534.385500:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893389696 00000100:00100000:3.0:1788612534.385560:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 110 00000100:00100000:3.0:1788612534.385570:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:10540:x1875495893389696:12345-192.168.202.6@tcp:58:lfs.0 00010000:00010000:3.0:1788612534.385670:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41f3b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.385688:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41f3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.385701:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41f3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788612534.385957:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788612534.386043:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:10540:x1875495893389696:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 473us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612534.386050:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 110 00000100:00100000:1.0:1788612534.389141:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612534.389284:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893389824 00000100:00100000:3.0:1788612534.389296:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893389824 00000100:00100000:3.0:1788612534.389358:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 111 00000100:00100000:3.0:1788612534.389367:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:10540:x1875495893389824:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612534.389402:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612534.389423:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41f42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda2b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.389489:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41f3b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.389501:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41f42 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda2b expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.389520:0:5853:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41f3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.389535:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41f42 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda2b expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.389547:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:3.0:1788612534.389550:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612534.389554:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41f42 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda2b expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612534.389562:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077a00, rc 0) 00000100:00100000:3.0:1788612534.389661:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:10540:x1875495893389824:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 294us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612534.389668:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 111 00000100:00100000:2.0:1788612534.829350:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914373888:0@lo:400:kworker.0 00000100:00100000:2.0:1788612534.829415:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612534.829471:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612534.829477:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914373760:0@lo:400:kworker.0 00000100:00100000:2.0:1788612534.829496:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612534.829563:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914373504:0@lo:400:kworker.0 00000100:00100000:0.0:1788612534.829595:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612534.829621:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914374016:0@lo:400:kworker.0 00000100:00100000:0.0:1788612534.829647:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612534.829667:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612534.829671:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914373632:0@lo:400:kworker.0 00000100:00100000:0.0:1788612534.829691:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612534.829718:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914374016 00000100:00100000:0.0:1788612534.829725:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914374016 00000100:00100000:0.0:1788612534.829777:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788612534.829797:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875495914374016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612534.829872:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875495914374016:12345-0@lo:400:kworker.0 Request processed in 66us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612534.829880:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788612534.829919:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914374016:0@lo:400:kworker.0 00000100:00100000:0.0:1788612534.829946:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914373888 00000100:00100000:0.0:1788612534.829950:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914373888 00000100:00100000:0.0:1788612534.829977:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914373760 00000100:00100000:0.0:1788612534.829980:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914373760 00000100:00100000:0.0:1788612534.829993:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914373632 00000100:00100000:0.0:1788612534.829996:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914373632 00000100:00100000:0.0:1788612534.830030:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788612534.830035:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914373888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612534.830072:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914373888:12345-0@lo:400:kworker.0 Request processed in 36us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612534.830077:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788612534.830088:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788612534.830094:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914373760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612534.830120:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914373760:12345-0@lo:400:kworker.0 Request processed in 26us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612534.830125:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788612534.830136:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788612534.830142:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914373632:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788612534.830165:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612534.830169:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914373632:12345-0@lo:400:kworker.0 Request processed in 27us (476us total) trans 0 rc 0/0 00000100:00080000:3.0:1788612534.830170:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612534.830174:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788612534.830195:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914373632:0@lo:400:kworker.0 00000100:00100000:3.0:1788612534.830206:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914373760:0@lo:400:kworker.0 00000100:00100000:3.0:1788612534.830226:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914373888:0@lo:400:kworker.0 00000100:00100000:2.0:1788612534.830344:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914373504 00000100:00100000:2.0:1788612534.830348:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914373504 00000100:00100000:2.0:1788612534.830385:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788612534.830392:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914373504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612534.830433:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914373504:12345-0@lo:400:kworker.0 Request processed in 43us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612534.830447:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788612534.834176:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914373504:0@lo:400:kworker.0 00010000:00010000:3.0:1788612534.892103:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612535.226751:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612535.226799:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612535.227032:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893390080 00000100:00100000:3.0:1788612535.227043:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893390080 00000100:00100000:3.0:1788612535.227116:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 135 00000100:00100000:3.0:1788612535.227127:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:2356:x1875495893390080:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612535.227204:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:2356:x1875495893390080:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 79us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612535.227222:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 135 00000100:00100000:1.0:1788612535.229600:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612535.229661:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00080000:2.0:1788612535.229714:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612535.229817:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893389952 00000100:00100000:3.0:1788612535.229827:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893389952 00000100:00100000:3.0:1788612535.229916:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 287 00000100:00100000:3.0:1788612535.229926:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2356:x1875495893389952:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612535.229987:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2356:x1875495893389952:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 63us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612535.229995:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 287 00000100:00100000:1.0:1788612535.231125:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612535.231200:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893390464 00000100:00100000:2.0:1788612535.231206:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893390464 00000100:00100000:2.0:1788612535.231270:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:2.0:1788612535.231279:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2356:x1875495893390464:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612535.231330:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+5:2356:x1875495893390464:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 52us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612535.231337:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00080000:1.0:1788612535.233532:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612535.234417:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893390336 00000100:00100000:0.0:1788612535.234430:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893390336 00000100:00080000:1.0:1788612535.234540:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612535.235528:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893390208 00000100:00100000:3.0:1788612535.235536:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893390208 00000100:00100000:3.0:1788612535.235607:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:3.0:1788612535.235618:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2356:x1875495893390336:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612535.235881:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2356:x1875495893390336:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 265us (9080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612535.235888:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:3.0:1788612535.235906:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:3.0:1788612535.235914:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2356:x1875495893390208:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612535.235954:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2356:x1875495893390208:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 42us (6293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612535.235960:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00080000:1.0:1788612535.236423:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788612535.340147:0:8112:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329183306492ns, next at 330183303749ns, rc = 0 00000100:00100000:1.0:1788612535.340406:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914374144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612535.340491:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612535.340793:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914374144 00000100:00100000:0.0:1788612535.340801:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914374144 00000100:00100000:0.0:1788612535.340885:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788612535.340896:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875495914374144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612535.340931:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612535.341004:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875495914374144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.341012:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788612535.341322:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914374144:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788612535.404358:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612535.404368:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612535.404415:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788612535.404423:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788612535.404544:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc3e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875495914374272:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788612535.404654:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612535.410138:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc3e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875495914374272:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788612535.414144:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.414601:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893390592 00000100:00100000:0.0:1788612535.414613:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893390592 00000100:00100000:0.0:1788612535.414683:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 112 00000100:00100000:0.0:1788612535.414693:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:10542:x1875495893390592:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788612535.414736:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788612535.414896:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:10542:x1875495893390592:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 204us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.414904:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 112 00000100:00100000:2.0:1788612535.429267:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.429403:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893390720 00000100:00100000:0.0:1788612535.429415:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893390720 00000100:00100000:0.0:1788612535.429481:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 113 00000100:00100000:0.0:1788612535.429491:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadeab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:10542:x1875495893390720:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788612535.429574:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f49 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429591:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429605:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429620:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f50 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429627:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429648:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429675:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41f57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429685:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429691:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612535.429729:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788612535.429733:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612535.429745:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429755:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429762:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f49 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429767:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f49 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429772:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdee00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612535.429776:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f49 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429783:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f49 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429799:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb600) 00010000:00010000:0.0:1788612535.429801:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612535.429806:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f49 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429812:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af41f49 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429825:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429832:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f50 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429884:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f50 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429889:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612535.429892:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f50 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.429898:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f50 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.430062:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff928e91fbb100) 00010000:00010000:0.0:1788612535.430066:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612535.430081:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f50 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.430088:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f50 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.430127:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.430134:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41f57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.430140:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.430145:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdec00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612535.430148:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.430153:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41f57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.430161:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:0.0:1788612535.430163:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612535.430166:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41f57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.430171:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41f57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612535.431809:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadeab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:10542:x1875495893390720:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 2307us (2539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.431824:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 113 00000100:00100000:3.0:1788612535.435165:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.435514:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893390976 00000100:00100000:0.0:1788612535.435525:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893390976 00000100:00100000:0.0:1788612535.435592:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00100000:0.0:1788612535.435617:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:10542:x1875495893390976:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612535.435641:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612535.435665:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41f5e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda32 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.435773:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.435789:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.435800:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612535.435811:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788612535.435972:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.435980:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.435986:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.435992:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612535.435996:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.436004:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.436016:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:0.0:1788612535.436025:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788612535.436031:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.436038:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.436082:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41f5e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda32 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.436092:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb600) 00010000:00010000:0.0:1788612535.436094:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612535.436098:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41f5e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda32 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.436108:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdfc00, rc 0) 00000100:00100000:0.0:1788612535.436175:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+56:10542:x1875495893390976:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 561us (1020us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1788612535.436183:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00100000:3.0:1788612535.439398:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.439499:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893391104 00000100:00100000:0.0:1788612535.439508:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893391104 00000100:00100000:0.0:1788612535.439579:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:0.0:1788612535.439591:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+56:10542:x1875495893391104:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788612535.439623:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788612535.439711:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+56:10542:x1875495893391104:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 122us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.439719:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:2.0:1788612535.444967:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612535.445175:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893391360 00000100:00100000:1.0:1788612535.445185:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893391360 00000100:00100000:1.0:1788612535.445250:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:1.0:1788612535.445261:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+56:10542:x1875495893391360:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612535.445286:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612535.445289:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788612535.445314:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af41f03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda16 expref: 56 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.445355:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:1.0:1788612535.445361:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612535.445376:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41f73 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda39 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788612535.446006:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788612535.446215:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af41f7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.446230:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af41f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.446241:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af41f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.446299:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41f73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda39 expref: 58 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.446314:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af41f7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda39 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.446322:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff928e838ce700) 00010000:00010000:1.0:1788612535.446325:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612535.446328:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61a00, rc 0) 00000100:00100000:1.0:1788612535.446403:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:10542:x1875495893391360:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1143us (1457us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788612535.446411:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:3.0:1788612535.464288:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.464388:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893391616 00000100:00100000:0.0:1788612535.464411:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893391616 00000100:00100000:0.0:1788612535.464483:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:0.0:1788612535.464495:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:10542:x1875495893391616:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788612535.464552:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612535.464590:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af41f7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda39 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464611:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff928e838ce700) 00010000:00010000:0.0:1788612535.464622:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612535.464644:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41f88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464659:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41f88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464669:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41f88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464735:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x201c533f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464744:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x201c533f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464751:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x201c533f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464816:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41f88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464823:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41f88 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464901:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41f88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464909:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdfc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612535.464913:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41f88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464922:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41f88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464930:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:0.0:1788612535.464934:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612535.464937:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41f88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464943:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af41f88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464954:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x201c533f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464960:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x201c533f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464965:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x201c533f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464970:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612535.464973:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x201c533f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464989:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x201c533f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.464996:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x201c533f (ffff928e91fbb100) 00010000:00010000:0.0:1788612535.464999:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612535.465001:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x201c533f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.465006:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41f8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x201c533f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612535.465085:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+56:10542:x1875495893391616:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 591us (806us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788612535.465094:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:3.0:1788612535.468556:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.468729:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893391744 00000100:00100000:0.0:1788612535.468740:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893391744 00000100:00100000:0.0:1788612535.468813:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:0.0:1788612535.468824:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec074a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+56:10542:x1875495893391744:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612535.468880:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612535.468903:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41f96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda40 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.468941:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.468953:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.468964:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.469066:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41f96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda40 expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.469084:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda40 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.469093:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff928e91fbb400) 00010000:00010000:0.0:1788612535.469095:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788612535.469099:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bde600, rc 0) 00000100:00100000:0.0:1788612535.469162:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec074a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:10542:x1875495893391744:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 340us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.469170:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:2.0:1788612535.481282:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.481404:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893392000 00000100:00100000:0.0:1788612535.481416:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893392000 00000100:00100000:0.0:1788612535.481483:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:0.0:1788612535.481494:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadeaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:10542:x1875495893392000:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788612535.481602:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41fa4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.481622:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.481635:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788612535.481974:0:8316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1788612535.482073:0:8316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058a0ddfe reply state 000000000fc05c12 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612535.482092:0:8316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612535.482196:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadeaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:10542:x1875495893392000:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 702us (925us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788612535.482204:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 119 00010000:00010000:0.0:1788612535.484113:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.484131:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41fa4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.484140:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.484146:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdec00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612535.484151:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.484159:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41fa4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.484176:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff928e91fbb400) 00010000:00010000:0.0:1788612535.484179:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788612535.484185:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41fa4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.484191:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41fa4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612535.487106:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612535.487189:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893392128 00000100:00100000:1.0:1788612535.487200:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893392128 00000100:00100000:1.0:1788612535.487257:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:1.0:1788612535.487267:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+58:10542:x1875495893392128:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612535.487291:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612535.487311:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41fab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda47 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.487374:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41fab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda47 expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.487392:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41fab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda47 expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.487414:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff928e91fbb400) 00010000:00010000:1.0:1788612535.487418:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612535.487423:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60c00, rc 0) 00000100:00100000:1.0:1788612535.487489:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:10542:x1875495893392128:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 223us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612535.487497:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:3.0:1788612535.490281:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.493553:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893392256 00000100:00100000:0.0:1788612535.493579:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893392256 00000100:00100000:0.0:1788612535.493747:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:0.0:1788612535.493759:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2356:x1875495893392256:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788612535.494125:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2356:x1875495893392256:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 367us (3852us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788612535.494133:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:3.0:1788612535.502097:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612535.502361:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893392512 00000100:00100000:1.0:1788612535.502372:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893392512 00000100:00100000:1.0:1788612535.502437:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:1.0:1788612535.502448:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:10542:x1875495893392512:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788612535.502704:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+60:10542:x1875495893392512:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 257us (616us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788612535.502712:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:1.0:1788612535.506328:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.506423:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893392768 00000100:00100000:0.0:1788612535.506433:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893392768 00000100:00100000:0.0:1788612535.506503:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:0.0:1788612535.506514:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+60:10542:x1875495893392768:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788612535.506635:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+60:10542:x1875495893392768:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 123us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.506643:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:2.0:1788612535.508729:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.508917:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893392896 00000100:00100000:0.0:1788612535.508925:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893392896 00000100:00100000:0.0:1788612535.508986:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:0.0:1788612535.508995:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+60:10542:x1875495893392896:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612535.509011:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612535.509032:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41fb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda4e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.509098:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41fb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.509112:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.509125:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612535.509173:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612535.509193:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.509231:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af41fb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda4e expref: 62 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.509250:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda4e expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.509259:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff928e91fbb400) 00010000:00010000:0.0:1788612535.509262:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788612535.509266:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf600, rc 0) 00000100:00100000:0.0:1788612535.509330:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:10542:x1875495893392896:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 337us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.509337:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:3.0:1788612535.516412:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.516552:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893393024 00000100:00100000:0.0:1788612535.516563:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893393024 00000100:00100000:0.0:1788612535.516627:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:0.0:1788612535.516638:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2355:x1875495893393024:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612535.516655:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612535.516677:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af41fc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda55 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788612535.516705:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c0fb7, blocks: 0x1 00010000:00010000:0.0:1788612535.516726:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1788612535.516745:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612535.516754:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af41fc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda55 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.516774:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af41fc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda55 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.516787:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdfc00, rc 0) 00000100:00100000:0.0:1788612535.516879:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+10:2355:x1875495893393024:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 233us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.516886:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:2.0:1788612535.523149:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.523229:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893393280 00000100:00100000:0.0:1788612535.523241:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893393280 00000100:00100000:0.0:1788612535.523302:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:0.0:1788612535.523311:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:10542:x1875495893393280:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788612535.523415:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:10542:x1875495893393280:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 103us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.523422:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:1.0:1788612535.532281:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612535.532479:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893393408 00000100:00100000:2.0:1788612535.532488:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893393408 00000100:00100000:2.0:1788612535.532548:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:2.0:1788612535.532558:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+10:10542:x1875495893393408:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612535.532584:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612535.532603:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af41fc7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda5c expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.532636:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af41fc0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda55 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.532664:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612535.532669:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612535.532676:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af41fc7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda5c expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.532710:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af41fc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda55 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.532723:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af41fc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda55 expref: 11 pid: 6697 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612535.532737:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875495914374400:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612535.532832:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612535.538912:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875495914374400:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612535.538967:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af41fc7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda5c expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.538989:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9a00, rc 0) 00000100:00100000:3.0:1788612535.539786:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:10542:x1875495893393408:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 7225us (7511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612535.539797:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:1.0:1788612535.545943:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612535.546152:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893393536 00000100:00100000:3.0:1788612535.546162:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893393536 00010000:00010000:3.0:1788612535.546203:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af41fc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda55 expref: 11 pid: 6697 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612535.546286:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:3.0:1788612535.546297:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0347b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:2356:x1875495893393536:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612535.546312:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612535.546334:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af41fc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda55 expref: 11 pid: 6697 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.546348:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af41fc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda55 expref: 11 pid: 6697 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.546371:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af41fc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda55 expref: 11 pid: 6697 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.546388:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612535.546392:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612535.546400:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af41fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda5c expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.546410:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af41fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda5c expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.546448:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af41fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda5c expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612535.546461:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0821180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5839:1875495914374528:192.168.202.6@tcp:105: 00000100:00100000:3.0:1788612535.546831:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612535.551550:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.552190:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893393664 00000100:00100000:0.0:1788612535.552201:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893393664 00002000:00100000:0.0:1788612535.552265:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff928ec0346680 x1875495893393664/t0(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:181/0 lens 504/0 e 0 to 0 dl 1788612546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788612535.552276:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928ec0346680 with x1875495893393664 ext(0->12) 00002000:00010000:0.0:1788612535.552282:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928ec0346680 00000100:00100000:0.0:1788612535.552314:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:0.0:1788612535.552325:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:2356:x1875495893393664:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788612535.553146:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:2356:x1875495893393664:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 Request processed in 819us (1602us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788612535.553156:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00002000:00100000:0.0:1788612535.553164:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff928ec0346680 x1875495893393664/t4294967308(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:181/0 lens 504/448 e 0 to 0 dl 1788612546 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788612535.553173:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928ec0346680 with x1875495893393664 ext(0->12) 00002000:00010000:0.0:1788612535.553177:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928ec0346680 00000100:00100000:3.0:1788612535.557950:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0821180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5839:1875495914374528:192.168.202.6@tcp:105: 00010000:00010000:3.0:1788612535.557981:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612535.558056:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0347b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:2356:x1875495893393536:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 11760us (12125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612535.558067:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:1.0:1788612535.561166:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.561375:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893393792 00000100:00100000:0.0:1788612535.561386:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893393792 00000100:00100000:0.0:1788612535.561453:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:0.0:1788612535.561463:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:10542:x1875495893393792:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788612535.625645:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1788612535.625671:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788612535.625688:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1788612535.626239:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914374656:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788612535.626310:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612535.626471:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914374656 00000100:00100000:2.0:1788612535.626479:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914374656 00000100:00100000:2.0:1788612535.626534:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788612535.626544:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875495914374656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788612535.626581:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1788612535.626607:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.626641:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af41d90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9bb expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.626650:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788612535.626655:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788612535.626659:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fce lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.626685:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af41d90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9bb expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.626709:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af41d90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9bb expref: 11 pid: 6698 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612535.626721:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadeaaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875495914374784:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612535.626778:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037dcc0 going to sleep for 11 seconds 00000020:00080000:0.0:1788612535.627498:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff928e91c5ff00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788612535.627505:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928d85b4e700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff928e86211300 00000020:00080000:0.0:1788612535.627508:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928d85b4ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff928ec034b800 00000004:00080000:0.0:1788612535.627529:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1788612535.627643:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:0.0:1788612535.627670:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff928e90aae840 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788612535.627673:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928ea7b77400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff928e90aaec00 00000020:00080000:0.0:1788612535.627676:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928ea7b77d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff928e83a6f800 00000020:00080000:3.0:1788612535.628530:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788612535.628762:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788612535.629087:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:10542:x1875495893393792:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 67620us (67924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612535.629098:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:1.0:1788612535.629407:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612535.629422:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec03afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914374912:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788612535.629472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612535.631105:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914374912 00000100:00100000:2.0:1788612535.631119:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914374912 00000100:00100000:2.0:1788612535.631190:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788612535.631199:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875495914374912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788612535.631291:0:8463:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1788612535.631328:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c0fb6, atime: 0x6a9c0fb6, ctime: 0x6a9c0fb6, blocks: 0x1 00010000:00010000:2.0:1788612535.631337:0:8463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41fd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.631375:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1788612535.631379:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612535.631386:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41fd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.631403:0:8463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41fd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.631414:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41fd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.631421:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41fd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.631447:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1788612535.632062:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788612535.632205:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612535.632220:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41fd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.632238:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612535.632243:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41fd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.632252:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41fd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.632270:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41fd5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.632278:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e869da27/0xfc956d548af41fd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.632302:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612535.632304:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612535.632306:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612535.636045:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.636178:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadeaaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875495914374784:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612535.636220:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612535.637146:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893393920 00000100:00100000:3.0:1788612535.637157:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893393920 00010000:00010000:3.0:1788612535.637202:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af41d90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9bb expref: 12 pid: 6698 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612535.638143:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:3.0:1788612535.638158:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0345500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:2355:x1875495893393920:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612535.638174:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612535.638182:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af41d90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9bb expref: 12 pid: 6698 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.638197:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af41d90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9bb expref: 12 pid: 6698 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612535.638788:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875495914374912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7587us (9312us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788612535.638798:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1788612535.639260:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af41d90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd9bb expref: 12 pid: 6698 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.639280:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612535.639300:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612535.639306:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.639316:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fce lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.639348:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612535.639404:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0345500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:2355:x1875495893393920:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 1251us (3369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612535.639411:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:0.0:1788612535.640334:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612535.640400:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893394048 00000100:00100000:3.0:1788612535.640408:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893394048 00000100:00100000:3.0:1788612535.640454:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:3.0:1788612535.640463:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:2353:x1875495893394048:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1788612535.640687:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff928ec03afb80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788612535.640705:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec03afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914374912:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788612535.641103:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.641116:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.641127:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.641147:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.641169:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612535.642093:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612535.642102:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.642113:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9e00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612535.642118:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.642127:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.642159:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.642167:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.642188:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612535.642190:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612535.642191:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612535.642239:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1875495914374656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15694us (15926us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788612535.642248:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1788612535.648546:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff928eadea9f80/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788612535.648582:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914374656:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788612535.720086:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:2353:x1875495893394048:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 79613us (79744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612535.720100:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000001:00080000:2.0:1788612535.723312:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1788612535.723355:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1788612535.729148:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612535.729618:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893394304 00000100:00100000:2.0:1788612535.729629:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893394304 00000100:00100000:2.0:1788612535.729814:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:2.0:1788612535.729926:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:10542:x1875495893394304:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788612535.729984:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612535.730010:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af41fb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda4e expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.730030:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff928e91fbb400) 00010000:00010000:2.0:1788612535.730037:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612535.730067:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41fdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.730080:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41fdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.730090:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41fdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612535.731054:0:8316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1cff560 reply state 00000000a4a7a9d9 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41fdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612535.731067:0:8316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788612535.731186:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:10542:x1875495893394304:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 1359us (2058us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788612535.731194:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 125 00010000:00010000:0.0:1788612535.734510:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41fdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.734541:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41fdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.734549:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41fdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.734555:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612535.734569:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41fdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.734579:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41fdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.734597:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff928e91fbb400) 00010000:00010000:0.0:1788612535.734600:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612535.734605:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41fdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.734612:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8600/0xfc956d548af41fdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612535.737089:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612535.737393:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893394432 00000100:00100000:2.0:1788612535.737405:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893394432 00000100:00100000:2.0:1788612535.737460:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:2.0:1788612535.737478:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893394432:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788612535.738562:0:8463:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788612535.738579:0:8463:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788612534 00002000:00010000:2.0:1788612535.738581:0:8463:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788612534 00002000:00010000:2.0:1788612535.738584:0:8463:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788612535 -> 1788612534 00002000:00010000:2.0:1788612535.738586:0:8463:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788612535.738665:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2355:x1875495893394432:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 1193us (1585us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788612535.738675:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:3.0:1788612535.744306:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612535.744664:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893394688 00000100:00100000:1.0:1788612535.744675:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893394688 00000100:00100000:1.0:1788612535.744754:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:1.0:1788612535.744765:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:10542:x1875495893394688:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788612535.744831:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.744891:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda40 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.744900:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.744933:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda40 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.744962:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda40 expref: 15 pid: 5854 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612535.744977:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0347100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914375040:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612535.745062:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e98c45b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612535.754290:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0347100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914375040:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612535.754321:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612535.757916:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.758009:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893394816 00000100:00100000:0.0:1788612535.758019:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893394816 00010000:00010000:0.0:1788612535.758061:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda40 expref: 16 pid: 5854 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612535.758098:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:0.0:1788612535.758107:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0821c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:2356:x1875495893394816:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612535.758120:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612535.758141:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda40 expref: 16 pid: 5854 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.758153:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda40 expref: 16 pid: 5854 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.758172:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af41f9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda40 expref: 16 pid: 5854 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.758187:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff928e91fbb400) 00010000:00010000:0.0:1788612535.758193:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.758201:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.758209:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.758250:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612535.758314:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0821c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:2356:x1875495893394816:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 207us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.758321:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00010000:00010000:1.0:1788612535.759520:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.759534:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.759573:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.759580:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.759587:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.759592:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612535.759596:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.759603:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.759631:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff928e91fbb400) 00010000:00010000:1.0:1788612535.759634:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788612535.759638:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.759645:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61c00/0xfc956d548af41fe3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612535.760110:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:10542:x1875495893394688:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 Request processed in 15342us (15809us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788612535.760119:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:3.0:1788612535.780201:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612535.780811:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893394944 00000100:00100000:2.0:1788612535.780822:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893394944 00000100:00100000:2.0:1788612535.780934:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:2.0:1788612535.780945:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2354:x1875495893394944:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788612535.780987:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fea lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.781025:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af41fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda5c expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.781035:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612535.781039:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788612535.781044:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fea lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.781078:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af41fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda5c expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.781093:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af41fc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda5c expref: 7 pid: 6695 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612535.781108:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec03ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875495914375168:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612535.781198:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788612535.784115:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec03ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875495914375168:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612535.784150:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fea lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612535.784707:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612535.784819:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893395072 00000100:00100000:2.0:1788612535.784826:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893395072 00010000:00010000:2.0:1788612535.784900:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af41fc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda5c expref: 8 pid: 6695 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612535.784949:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:2.0:1788612535.784957:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0820380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2356:x1875495893395072:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612535.784970:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612535.784990:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af41fc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda5c expref: 8 pid: 6695 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.785001:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af41fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda5c expref: 8 pid: 6695 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.785020:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af41fc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda5c expref: 8 pid: 6695 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.785035:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788612535.785040:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788612535.785046:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.785055:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fea lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.785084:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612535.785130:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0820380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2356:x1875495893395072:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 174us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612535.785137:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 59 00010000:00010000:3.0:1788612535.785773:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.785784:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.785820:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.785828:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.785868:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.785884:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9e00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612535.785889:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.785898:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.785912:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.785920:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af41fea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612535.786022:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2354:x1875495893394944:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 5078us (5832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612535.786030:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:3.0:1788612535.794276:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612535.794347:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893395328 00000100:00100000:2.0:1788612535.794358:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893395328 00000100:00100000:2.0:1788612535.794422:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:2.0:1788612535.794432:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:10542:x1875495893395328:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788612535.794522:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ff1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.794541:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ff1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.794553:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ff1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.794771:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.794783:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41fab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda47 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.794791:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.794822:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41fab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda47 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.794895:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41fab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda47 expref: 15 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612535.794911:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec03ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914375296:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612535.794979:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788612535.799652:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec03ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914375296:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612535.799686:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612535.800415:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.800495:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893395456 00000100:00100000:0.0:1788612535.800503:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893395456 00010000:00010000:0.0:1788612535.800541:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41fab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda47 expref: 16 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612535.800585:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:0.0:1788612535.800594:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0822d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+16:2355:x1875495893395456:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612535.800624:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612535.800632:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41fab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda47 expref: 16 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.800646:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41fab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda47 expref: 16 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.800666:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af41fab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda47 expref: 16 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.800681:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff928e91fbb400) 00010000:00010000:0.0:1788612535.800686:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.800707:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.800715:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.800746:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612535.800804:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0822d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:2355:x1875495893395456:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 210us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612535.800812:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00010000:00010000:2.0:1788612535.801082:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.801089:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788612535.801270:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788612535.801409:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788612535.801450:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788612535.801526:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec03ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1875495914375424:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788612535.801574:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612535.801646:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612535.809117:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914375424 00000100:00100000:0.0:1788612535.809135:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914375424 00000100:00100000:1.0:1788612535.809379:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612535.809391:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875495914375424:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788612535.809532:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875495914375424:12345-0@lo:1000:mdt00_000.0 Request processed in 143us (7957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612535.809540:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612535.809644:0:5852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788612535.809650:0:5852:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1788612535.809671:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff928eadea9f80, transno 4294967309 00000100:00100000:3.0:1788612535.809692:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec03ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1875495914375424:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788612535.810826:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788612535.811175:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0821880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1875495914375552:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788612535.811393:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612535.811419:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612535.811575:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914375552 00000100:00100000:1.0:1788612535.811581:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914375552 00000100:00100000:1.0:1788612535.811628:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788612535.811637:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875495914375552:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788612535.812137:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1875495914375552:12345-0@lo:1000:mdt00_000.0 Request processed in 498us (742us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788612535.812146:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612535.814054:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0821880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1875495914375552:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788612535.814106:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814118:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814125:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814130:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612535.814135:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814143:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814159:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff928e91fbb400) 00010000:00010000:3.0:1788612535.814162:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612535.814183:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814190:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af41ff8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814387:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41f3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814394:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41f3b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814400:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41f3b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814404:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0076000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612535.814407:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41f3b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814413:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41f3b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814422:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:3.0:1788612535.814424:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612535.814431:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41f42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda2b expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814442:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41f42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda2b expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814451:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41f42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda2b expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.814508:0:5852:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41f42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda2b expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612535.814522:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0823100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914375680:192.168.202.6@tcp:105: 00000100:00100000:3.0:1788612535.814656:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc600 going to sleep for 11 seconds 00000100:00100000:2.0:1788612535.825414:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0823100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914375680:192.168.202.6@tcp:105: 00010000:00010000:2.0:1788612535.825446:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41f3b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825458:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af41f3b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825507:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41fff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825521:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41fff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825533:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41fff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825563:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41fff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825570:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41fff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825576:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41fff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825582:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612535.825585:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41fff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825592:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41fff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825603:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:2.0:1788612535.825606:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612535.825610:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41fff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825615:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af41fff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825624:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ff1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825630:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ff1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825636:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ff1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825648:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612535.825651:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ff1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825658:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ff1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825667:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:2.0:1788612535.825670:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788612535.825673:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ff1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.825679:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af41ff1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612535.826070:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:10542:x1875495893395328:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 31637us (31802us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788612535.826081:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 127 00000020:00080000:2.0:1788612535.826087:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788612535.826821:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612535.826826:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612535.827351:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788612535.827364:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788612535.828001:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612535.830127:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893395584 00000100:00100000:3.0:1788612535.830143:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893395584 00000100:00100000:3.0:1788612535.830209:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:0.0:1788612535.830562:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612535.830624:0:5855:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1788612535.830634:0:5855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1788612535.831100:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:10540:x1875495893395584:12345-192.168.202.6@tcp:49:lfs.0 00000100:00100000:3.0:1788612535.831278:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:10540:x1875495893395584:12345-192.168.202.6@tcp:49:lfs.0 Request processed in 1059us (3280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612535.831287:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:3.0:1788612535.831306:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893395840 00000100:00100000:3.0:1788612535.831310:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893395840 00000100:00100000:3.0:1788612535.831332:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:3.0:1788612535.831340:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e8347c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:10542:x1875495893395840:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788612535.834624:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788612535.834734:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788612535.834802:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af42006 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.834819:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af42006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.835131:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af42006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.835143:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af42006 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.835150:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af42006 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.835156:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af42006 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.835225:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788612535.835323:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e8347c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:10542:x1875495893395840:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 3979us (4757us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788612535.835332:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 32 00000020:00080000:3.0:1788612535.835338:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788612535.839081:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612535.839108:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af42006 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.839120:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0076800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612535.839124:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af42006 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.839134:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af42006 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.839150:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:0.0:1788612535.839154:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788612535.839159:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af42006 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.839165:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af42006 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612535.839279:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612535.839282:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612535.839284:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612535.841521:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612535.841596:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893396096 00000100:00100000:2.0:1788612535.841605:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893396096 00000100:00100000:2.0:1788612535.841664:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:2.0:1788612535.841674:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:10540:x1875495893396096:12345-192.168.202.6@tcp:58:lfs.0 00000040:00080000:2.0:1788612535.842147:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788612535.842374:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:10540:x1875495893396096:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 700us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612535.842383:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:2.0:1788612535.881375:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.881539:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893396224 00000100:00100000:0.0:1788612535.881549:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893396224 00000100:00100000:0.0:1788612535.881622:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 129 00000100:00100000:0.0:1788612535.881634:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:10544:x1875495893396224:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1788612535.881656:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612535.881678:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4200d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda63 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.881749:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42014 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.881763:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42014 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.881789:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42014 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.881803:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4201b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.881810:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4201b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612535.881815:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4201b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.883209:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af42022 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.883661:0:8316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda24 expref: 21 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.883670:0:8316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af42022 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.883716:0:8316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda24 expref: 21 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.883734:0:8316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda24 expref: 21 pid: 8316 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612535.883750:0:8316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec03aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8316:1875495914375808:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612535.883852:0:8316:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec037d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788612535.888357:0:8316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec03aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8316:1875495914375808:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612535.888393:0:8316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af42022 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612535.888748:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612535.888821:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893396480 00000100:00100000:0.0:1788612535.888830:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893396480 00000100:00100000:2.0:1788612535.889131:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:2.0:1788612535.889143:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+22:5594:x1875495893396480:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788612535.889553:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+23:5594:x1875495893396480:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 411us (803us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788612535.889561:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:0.0:1788612535.899587:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612535.899893:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893396608 00000100:00100000:2.0:1788612535.899903:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893396608 00010000:00010000:2.0:1788612535.899953:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda24 expref: 23 pid: 8316 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612535.899997:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:2.0:1788612535.900007:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9238e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+23:2355:x1875495893396608:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612535.900022:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612535.900029:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda24 expref: 23 pid: 8316 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.900042:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda24 expref: 23 pid: 8316 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.900064:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af41f2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda24 expref: 23 pid: 8316 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.900081:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:2.0:1788612535.900088:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af42022 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.900098:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af42022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.900107:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af42022 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612535.900143:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612535.900205:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9238e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+22:2355:x1875495893396608:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 199us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612535.900238:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00010000:00010000:3.0:1788612535.900913:0:8316:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af42022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.900925:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af42022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612535.900984:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788612535.900988:0:8316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612535.901008:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af42022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901023:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af42022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901047:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42014 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901054:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42014 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901060:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42014 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901066:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdea00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612535.901070:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42014 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901077:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42014 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901089:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:3.0:1788612535.901091:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612535.901095:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42014 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901101:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42014 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901113:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4201b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901119:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4201b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901124:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4201b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901135:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612535.901138:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4201b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901144:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4201b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901151:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff928e91fbbb00) 00010000:00010000:3.0:1788612535.901153:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612535.901156:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4201b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901162:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4201b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901201:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4200d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda63 expref: 22 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901389:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af42022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda63 expref: 21 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612535.901398:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:3.0:1788612535.901401:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612535.901403:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8200, rc 0) 00000100:00100000:3.0:1788612535.901456:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:10544:x1875495893396224:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 19825us (20093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612535.901465:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 129 00010000:00010000:1.0:1788612535.917579:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788612536.881217:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612536.881370:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612536.881424:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788612536.881435:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788612536.881571:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0822680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875495914375936:192.168.202.6@tcp:107:hsm_cdtr.0 00000040:00080000:2.0:1788612536.885462:0:12108:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788612536.885474:0:12108:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612536.885541:0:12108:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788612536.885548:0:12108:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788612536.891174:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612536.902608:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612536.902740:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893396736 00000100:00100000:0.0:1788612536.902750:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893396736 00000100:00100000:0.0:1788612536.902822:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 130 00000100:00100000:0.0:1788612536.902832:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+22:10555:x1875495893396736:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788612536.902895:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788612536.903008:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+22:10555:x1875495893396736:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 177us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612536.903015:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 130 00000100:00100000:3.0:1788612536.904536:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0822680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875495914375936:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788612536.915942:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612536.916154:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893396992 00000100:00100000:2.0:1788612536.916165:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893396992 00000100:00100000:2.0:1788612536.916220:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:2.0:1788612536.916229:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:10555:x1875495893396992:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612536.916264:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612536.916287:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42029 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda6a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612536.916385:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af42030 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612536.916401:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af42030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612536.916414:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af42030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612536.916426:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788612536.916559:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42029 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda6a expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612536.916579:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af42030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda6a expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612536.916601:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:2.0:1788612536.916604:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612536.916609:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9e00, rc 0) 00000100:00100000:2.0:1788612536.916680:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+23:10555:x1875495893396992:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 451us (749us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788612536.916688:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 131 00000100:00100000:3.0:1788612536.929974:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612536.930089:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893397120 00000100:00100000:1.0:1788612536.930100:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893397120 00000100:00100000:1.0:1788612536.930174:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:1.0:1788612536.930196:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+23:2354:x1875495893397120:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612536.930212:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612536.930236:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af42030 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda6a expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612536.930259:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:1.0:1788612536.930264:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612536.930321:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+22:2354:x1875495893397120:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 128us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612536.930328:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:3.0:1788612536.941382:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612536.941485:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893397376 00000100:00100000:1.0:1788612536.941497:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893397376 00000100:00100000:1.0:1788612536.941557:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 132 00000100:00100000:1.0:1788612536.941568:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+22:10555:x1875495893397376:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788612536.941649:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af4203e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612536.941667:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af4203e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612536.941678:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af4203e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612536.941926:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af4203e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612536.941949:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af4203e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612536.941956:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af4203e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612536.941962:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612536.941966:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af4203e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612536.941977:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af4203e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612536.941989:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:1.0:1788612536.941992:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788612536.941997:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af4203e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612536.942002:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af4203e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612536.942148:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+23:10555:x1875495893397376:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 580us (773us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788612536.942156:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 132 00000040:00080000:3.0:1788612536.942592:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612536.942597:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612536.943109:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788612536.943120:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788612536.945417:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612536.953758:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612536.953968:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893397632 00000100:00100000:3.0:1788612536.953979:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893397632 00000100:00100000:3.0:1788612536.954044:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:3.0:1788612536.954056:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+23:10555:x1875495893397632:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788612536.954326:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+24:10555:x1875495893397632:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 271us (576us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788612536.954333:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00010000:00010000:1.0:1788612537.964655:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788612538.528922:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788612538.528942:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:2.0:1788612538.989087:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788612538.989378:0:12161:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612538.989384:0:12161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612538.989425:0:12161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788612538.989433:0:12161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788612539.228173:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612539.228250:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893397888 00000100:00100000:3.0:1788612539.228260:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893397888 00000100:00100000:3.0:1788612539.228342:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 133 00000100:00100000:3.0:1788612539.228353:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+24:10576:x1875495893397888:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612539.228387:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612539.228451:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42045 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda71 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612539.228573:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af4204c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612539.228589:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af4204c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612539.228602:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af4204c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612539.228614:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788612539.228745:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42045 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda71 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612539.228763:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af4204c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda71 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612539.228770:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:3.0:1788612539.228773:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788612539.228777:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0076800, rc 0) 00000100:00100000:3.0:1788612539.228864:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+26:10576:x1875495893397888:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 512us (700us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788612539.228870:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 133 00000100:00080000:1.0:1788612539.228993:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612539.231632:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612539.231887:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893398016 00000100:00100000:1.0:1788612539.231906:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893398016 00000100:00100000:1.0:1788612539.231958:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 134 00000100:00100000:1.0:1788612539.231968:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+26:10576:x1875495893398016:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:1.0:1788612539.232032:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4205a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612539.232049:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4205a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612539.232060:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4205a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612539.232086:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4205a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612539.232093:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4205a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612539.232099:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4205a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612539.232104:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612539.232108:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4205a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612539.232115:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4205a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612539.232125:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:1.0:1788612539.232128:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612539.232132:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4205a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612539.232147:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4205a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612539.232227:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+26:10576:x1875495893398016:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 261us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612539.232234:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 134 00000100:00100000:0.0:1788612539.365441:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612539.365592:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893398144 00000100:00100000:2.0:1788612539.365603:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893398144 00000100:00100000:2.0:1788612539.365667:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:2.0:1788612539.365676:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893398144:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:2.0:1788612539.365694:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612539.365723:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df5b8eec/0xfc956d548af42061 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda78 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612539.365750:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c0fb6, atime: 0x6a9c0fb6, ctime: 0x6a9c0fb6, blocks: 0xb 00010000:00010000:2.0:1788612539.365775:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=333s v=(0 0) 00010000:00010000:2.0:1788612539.365779:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612539.365788:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df5b8eec/0xfc956d548af42061 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda78 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612539.365806:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df5b8eec/0xfc956d548af42061 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda78 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612539.365861:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8600, rc 0) 00000100:00100000:2.0:1788612539.365927:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2355:x1875495893398144:12345-192.168.202.6@tcp:101:cat.0 Request processed in 252us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612539.365934:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00080000:0.0:1788612539.366107:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612539.370693:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612539.370989:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893398272 00000100:00100000:1.0:1788612539.371000:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893398272 00002000:00100000:1.0:1788612539.371049:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff928e90cad180 x1875495893398272/t0(0) o3->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:185/0 lens 488/0 e 0 to 0 dl 1788612550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788612539.371060:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928e90cad180 with x1875495893398272 ext(0->4095) 00002000:00010000:1.0:1788612539.371065:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928e90cad180 00000100:00100000:1.0:1788612539.371146:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:1.0:1788612539.371156:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2354:x1875495893398272:12345-192.168.202.6@tcp:3:cat.0 00000100:00100000:1.0:1788612539.372055:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2354:x1875495893398272:12345-192.168.202.6@tcp:3:cat.0 Request processed in 894us (1367us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788612539.372066:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00002000:00100000:1.0:1788612539.372075:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff928e90cad180 x1875495893398272/t0(0) o3->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:185/0 lens 488/4536 e 0 to 0 dl 1788612550 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788612539.372084:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928e90cad180 with x1875495893398272 ext(0->4095) 00002000:00010000:1.0:1788612539.372088:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928e90cad180 00000100:00100000:2.0:1788612539.436985:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914376064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612539.437067:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612539.437810:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376064 00000100:00100000:0.0:1788612539.437821:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376064 00000100:00100000:0.0:1788612539.437912:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788612539.437924:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914376064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788612539.437960:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788612539.438042:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612539.448878:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914376064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10945us (11798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612539.448906:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788612539.457088:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788612539.457101:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788612539.457132:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff928ec03afb80, transno 4294967304 00000100:00100000:2.0:1788612539.457180:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914376064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612539.948194:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914376448:0@lo:400:kworker.0 00000100:00100000:0.0:1788612539.948266:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612539.948346:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612539.948353:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadeaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914376320:0@lo:400:kworker.0 00000100:00100000:0.0:1788612539.948379:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612539.948538:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914376192:0@lo:400:kworker.0 00000100:00100000:1.0:1788612539.948576:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612539.948618:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914376704:0@lo:400:kworker.0 00000100:00100000:1.0:1788612539.948642:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612539.948660:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612539.948666:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914376576:0@lo:400:kworker.0 00000100:00100000:1.0:1788612539.948712:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376192 00000100:00100000:1.0:1788612539.948719:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376192 00000100:00100000:1.0:1788612539.948763:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788612539.948772:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3306:x1875495914376192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612539.948821:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3306:x1875495914376192:12345-0@lo:400:kworker.0 Request processed in 50us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612539.948827:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788612539.948894:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376704 00000100:00100000:1.0:1788612539.948899:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376704 00000100:00100000:1.0:1788612539.948944:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788612539.948950:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875495914376704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612539.948982:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875495914376704:12345-0@lo:400:kworker.0 Request processed in 32us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612539.948988:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1788612539.949006:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612539.949605:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612539.955272:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914376192:0@lo:400:kworker.0 00000100:00100000:0.0:1788612539.955296:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914376704:0@lo:400:kworker.0 00000100:00100000:1.0:1788612539.955733:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376448 00000100:00100000:1.0:1788612539.955742:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376448 00000100:00100000:1.0:1788612539.955817:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376320 00000100:00100000:1.0:1788612539.955820:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376320 00000100:00100000:1.0:1788612539.955834:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376576 00000100:00100000:1.0:1788612539.955856:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376576 00000100:00100000:1.0:1788612539.955881:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788612539.955889:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914376448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612539.955978:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914376448:12345-0@lo:400:kworker.0 Request processed in 89us (7710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612539.955998:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788612539.956015:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788612539.956020:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914376320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612539.956050:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914376320:12345-0@lo:400:kworker.0 Request processed in 31us (7671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612539.956056:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788612539.956067:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788612539.956073:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914376576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612539.956103:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914376576:12345-0@lo:400:kworker.0 Request processed in 30us (6501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612539.956108:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:0.0:1788612539.961695:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612539.961760:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914376576:0@lo:400:kworker.0 00000100:00100000:0.0:1788612539.961800:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadeaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914376320:0@lo:400:kworker.0 00000100:00100000:0.0:1788612539.961813:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914376448:0@lo:400:kworker.0 00010000:00010000:1.0:1788612540.012239:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612540.352019:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612540.352054:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612540.352084:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612540.352108:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612540.352137:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612540.352183:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893398784 00000100:00100000:0.0:1788612540.352193:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893398784 00000100:00100000:0.0:1788612540.352234:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893398656 00000100:00100000:0.0:1788612540.352236:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893398656 00000100:00100000:0.0:1788612540.352261:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:0.0:1788612540.352271:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2353:x1875495893398784:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612540.352335:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2353:x1875495893398784:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 66us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612540.352342:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:0.0:1788612540.352358:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:0.0:1788612540.352365:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2353:x1875495893398656:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612540.352386:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2353:x1875495893398656:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612540.352393:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00080000:0.0:1788612540.352407:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612540.352767:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893398528 00000100:00100000:1.0:1788612540.352772:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893398528 00000100:00100000:1.0:1788612540.352810:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893398912 00000100:00100000:1.0:1788612540.352812:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893398912 00000100:00100000:1.0:1788612540.352877:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 140 00000100:00100000:1.0:1788612540.352885:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+26:2353:x1875495893398528:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612540.352931:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+26:2353:x1875495893398528:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 47us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612540.352937:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 140 00000100:00100000:1.0:1788612540.352949:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 141 00000100:00100000:1.0:1788612540.352954:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893398912:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612540.352972:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2353:x1875495893398912:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 19us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612540.352988:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 141 00000100:00100000:3.0:1788612540.353320:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893398400 00000100:00100000:3.0:1788612540.353326:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893398400 00000100:00100000:3.0:1788612540.353381:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 289 00000100:00100000:3.0:1788612540.353396:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2353:x1875495893398400:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612540.353427:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2353:x1875495893398400:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 33us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612540.353435:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 289 00000100:00080000:0.0:1788612540.354160:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788612540.460261:0:8112:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334303419496ns, next at 335303416642ns, rc = 0 00000100:00100000:2.0:1788612540.460315:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612540.460336:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914376832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612540.460408:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612540.460551:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376832 00000100:00100000:0.0:1788612540.460560:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376832 00000100:00100000:0.0:1788612540.460618:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788612540.460629:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875495914376832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612540.460663:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612540.460716:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875495914376832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612540.460723:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788612540.460799:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914376832:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788612541.035931:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788612541.088885:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788612541.088908:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000004:00080000:1.0:1788612541.088973:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:1.0:1788612541.089001:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:1.0:1788612541.089020:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1788612541.089032:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff928ec00dc300 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788612541.089037:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928ec00c4900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff928ec00dc540 00000020:00080000:1.0:1788612541.089041:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928ec00c4d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff928ea7882c00 00000020:00080000:1.0:1788612541.089056:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:0.0:1788612541.089600:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612541.089710:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914376960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788612541.089775:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612541.089978:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914376960 00000100:00100000:2.0:1788612541.089985:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914376960 00000100:00100000:2.0:1788612541.090038:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788612541.090048:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914376960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788612541.090324:0:8463:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788612541.090328:0:8463:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788612534 -> 1788612534 00002000:00010000:2.0:1788612541.090330:0:8463:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1788612534 -> 1788612534 00002000:00010000:2.0:1788612541.090333:0:8463:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788612534 -> 1788612534 00002000:00010000:2.0:1788612541.090335:0:8463:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788612541.090390:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875495914376960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 343us (613us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788612541.090398:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788612541.090440:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788612541.090445:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:2.0:1788612541.090465:0:3307:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff928ec0997480 x1875495914376960/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788612557 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788612541.090475:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff928ec0997480/2, rc 0, transno 4294967312 00000100:00100000:2.0:1788612541.090479:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914376960:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788612541.090582:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1788612541.092479:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788612541.092798:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1788612542.060051:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788612542.060812:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612542.060819:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612542.061169:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788612542.061177:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788612543.086491:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612544.108169:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612544.496512:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612544.498458:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893399040 00000100:00100000:1.0:1788612544.498473:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893399040 00000100:00100000:1.0:1788612544.498566:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 135 00000100:00100000:1.0:1788612544.498578:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:10221:x1875495893399040:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788612544.498745:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:10221:x1875495893399040:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 Request processed in 170us (2245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612544.498753:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 135 00000100:00080000:0.0:1788612544.498914:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612544.504643:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612544.504716:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893399296 00000100:00100000:0.0:1788612544.504727:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893399296 00000100:00100000:0.0:1788612544.504792:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:0.0:1788612544.504803:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:10221:x1875495893399296:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788612544.514779:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:10221:x1875495893399296:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 9963us (10132us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788612544.514795:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:2.0:1788612544.557627:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914377088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612544.557703:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612544.557792:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377088 00000100:00100000:2.0:1788612544.557800:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377088 00000100:00100000:2.0:1788612544.557886:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788612544.557896:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914377088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612544.557933:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612544.557989:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914377088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612544.557996:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788612544.558020:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612544.558053:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914377088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612544.730192:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612544.730293:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893399424 00000100:00100000:2.0:1788612544.730304:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893399424 00000100:00100000:2.0:1788612544.730491:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00100000:2.0:1788612544.730502:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+5:11032:x1875495893399424:12345-192.168.202.6@tcp:101:lsof.0 00010000:00010000:2.0:1788612544.730536:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612544.730559:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda7f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.730622:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af4206f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.730636:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af4206f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.730896:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af4206f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612544.730935:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788612544.730947:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612544.730986:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af4206f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.731010:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda7f expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.731027:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af4206f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda7f expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612544.731035:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928ea7bbc000) 00010000:00010000:2.0:1788612544.731037:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612544.731041:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9e00, rc 0) 00000100:00100000:2.0:1788612544.731101:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+6:11032:x1875495893399424:12345-192.168.202.6@tcp:101:lsof.0 Request processed in 601us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612544.731108:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 136 00000100:00080000:0.0:1788612544.731725:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612545.068333:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612545.068366:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914377216:0@lo:400:kworker.0 00000100:00100000:2.0:1788612545.068435:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612545.068516:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377216 00000100:00100000:2.0:1788612545.068523:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377216 00000100:00100000:2.0:1788612545.068582:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788612545.068592:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914377216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612545.068641:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914377216:12345-0@lo:400:kworker.0 Request processed in 50us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612545.068660:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788612545.068710:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914377216:0@lo:400:kworker.0 00000100:00100000:3.0:1788612545.069241:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914377344:0@lo:400:kworker.0 00000100:00100000:3.0:1788612545.069298:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612545.069569:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377344 00000100:00100000:0.0:1788612545.069576:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377344 00000100:00100000:0.0:1788612545.069615:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788612545.069623:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914377344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612545.070010:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914377472:0@lo:400:kworker.0 00000100:00100000:2.0:1788612545.070039:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612545.070074:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377472 00000100:00100000:2.0:1788612545.070077:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377472 00000100:00100000:2.0:1788612545.070112:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788612545.070120:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914377472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612545.070156:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914377472:12345-0@lo:400:kworker.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612545.070162:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788612545.070200:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914377472:0@lo:400:kworker.0 00000100:00080000:2.0:1788612545.070263:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612545.073203:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914377344:12345-0@lo:400:kworker.0 Request processed in 3570us (3894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612545.073439:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788612545.073801:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914377728:0@lo:400:kworker.0 00000100:00100000:0.0:1788612545.073887:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612545.073929:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612545.073935:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914377600:0@lo:400:kworker.0 00000100:00100000:0.0:1788612545.073974:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612545.074006:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377600 00000100:00100000:0.0:1788612545.074026:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377600 00000100:00100000:0.0:1788612545.074081:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788612545.074089:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914377600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612545.074140:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914377600:12345-0@lo:400:kworker.0 Request processed in 52us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612545.074146:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1788612545.074163:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612545.074190:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914377600:0@lo:400:kworker.0 00000100:00100000:1.0:1788612545.075082:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377728 00000100:00100000:1.0:1788612545.075090:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377728 00000100:00100000:1.0:1788612545.075154:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788612545.075162:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875495914377728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612545.075229:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875495914377728:12345-0@lo:400:kworker.0 Request processed in 67us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612545.075236:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788612545.077100:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612545.077159:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914377728:0@lo:400:kworker.0 00000100:00100000:3.0:1788612545.078302:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914377344:0@lo:400:kworker.0 00010000:00010000:2.0:1788612545.132094:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612545.468414:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612545.468460:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612545.468501:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612545.468520:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612545.468542:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612545.468583:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893399680 00000100:00100000:3.0:1788612545.468591:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893399680 00000100:00100000:3.0:1788612545.468639:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893400064 00000100:00100000:3.0:1788612545.468643:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893400064 00000100:00100000:3.0:1788612545.468677:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 145 00000100:00100000:3.0:1788612545.468688:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:2356:x1875495893399680:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612545.468771:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:2356:x1875495893399680:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 85us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612545.468779:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 145 00000100:00100000:3.0:1788612545.468795:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 146 00000100:00100000:3.0:1788612545.468801:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+6:2356:x1875495893400064:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612545.468823:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+6:2356:x1875495893400064:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 21us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612545.468829:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 146 00000100:00100000:1.0:1788612545.469050:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893399936 00000100:00100000:1.0:1788612545.469062:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893399936 00000100:00100000:1.0:1788612545.469110:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893399808 00000100:00100000:1.0:1788612545.469113:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893399808 00000100:00100000:1.0:1788612545.469135:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:1.0:1788612545.469143:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893399936:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612545.469171:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893399936:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 29us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612545.469176:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:1.0:1788612545.469188:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:1.0:1788612545.469195:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2356:x1875495893399808:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612545.469217:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2356:x1875495893399808:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612545.469222:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:1.0:1788612545.469242:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893399552 00000100:00100000:1.0:1788612545.469245:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893399552 00000100:00100000:1.0:1788612545.469266:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 291 00000100:00100000:1.0:1788612545.469272:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2356:x1875495893399552:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612545.469293:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2356:x1875495893399552:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 21us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612545.469298:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 291 00000100:00080000:3.0:1788612545.470613:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788612545.470620:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612545.581180:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612545.581203:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914377856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612545.581348:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612545.581601:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377856 00000100:00100000:0.0:1788612545.581609:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377856 00000100:00100000:0.0:1788612545.581662:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788612545.581672:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875495914377856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612545.581708:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612545.581875:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875495914377856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612545.581883:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788612545.585910:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914377856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788612546.156252:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788612546.164225:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1788612546.164249:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788612546.164266:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788612546.164277:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:1.0:1788612546.170135:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:2.0:1788612547.180017:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612548.217125:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788612548.936372:0:12363:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:49:07 (1788612547) 00010000:00010000:2.0:1788612549.228039:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612549.677031:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612549.677058:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914377984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612549.677145:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612549.677459:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914377984 00000100:00100000:3.0:1788612549.677469:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914377984 00000100:00100000:3.0:1788612549.677645:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788612549.677653:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914377984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612549.677686:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612549.677732:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914377984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612549.677737:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788612549.677798:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914377984:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788612549.677871:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612550.189524:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914378112:0@lo:400:kworker.0 00000100:00100000:1.0:1788612550.189534:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914378368:0@lo:400:kworker.0 00000100:00100000:3.0:1788612550.189626:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914378240:0@lo:400:kworker.0 00000100:00100000:0.0:1788612550.189629:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914378496:0@lo:400:kworker.0 00000100:00100000:1.0:1788612550.191490:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612550.191628:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914378368 00000100:00100000:1.0:1788612550.191637:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914378368 00000100:00100000:1.0:1788612550.191703:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788612550.191714:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914378368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612550.191785:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914378368:12345-0@lo:400:kworker.0 Request processed in 73us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612550.191794:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788612550.191861:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914378368:0@lo:400:kworker.0 00000100:00080000:1.0:1788612550.191893:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612550.200866:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612550.200937:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914378624:0@lo:400:kworker.0 00000100:00100000:2.0:1788612550.201005:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612550.201070:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914378112 00000100:00100000:2.0:1788612550.201079:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914378112 00000100:00100000:2.0:1788612550.201139:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788612550.201149:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914378112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612550.201204:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914378112:12345-0@lo:400:kworker.0 Request processed in 56us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612550.201212:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788612550.201249:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914378624 00000100:00100000:2.0:1788612550.201254:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914378624 00000100:00100000:2.0:1788612550.201293:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788612550.201300:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914378624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612550.201331:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914378624:12345-0@lo:400:kworker.0 Request processed in 33us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612550.201338:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1788612550.201360:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612550.201386:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914378112:0@lo:400:kworker.0 00000100:00100000:2.0:1788612550.201400:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914378624:0@lo:400:kworker.0 00000100:00100000:0.0:1788612550.207700:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612550.207903:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914378496 00000100:00100000:1.0:1788612550.207914:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914378496 00000100:00100000:1.0:1788612550.207992:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788612550.208004:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914378496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612550.208088:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914378496:12345-0@lo:400:kworker.0 Request processed in 87us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612550.208096:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788612550.208463:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914378496:0@lo:400:kworker.0 00000100:00100000:3.0:1788612550.212658:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612550.212735:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914378752:0@lo:400:kworker.0 00000100:00100000:3.0:1788612550.212780:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612550.212909:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914378752 00000100:00100000:2.0:1788612550.212934:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914378752 00000100:00100000:2.0:1788612550.213013:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788612550.213025:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914378752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612550.213141:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914378240 00000100:00080000:3.0:1788612550.213144:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612550.213147:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914378240 00000100:00100000:0.0:1788612550.213184:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788612550.213192:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914378240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612550.220413:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914378752:12345-0@lo:400:kworker.0 Request processed in 7376us (7616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612550.220432:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788612550.220574:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914378240:12345-0@lo:400:kworker.0 Request processed in 7381us (7923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612550.220604:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788612550.220778:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914378240:0@lo:400:kworker.0 00000100:00100000:3.0:1788612550.220793:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788612550.220798:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff928ec0997480, transno 4294967312 00000100:00100000:3.0:1788612550.220818:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914378752:0@lo:400:kworker.0 00010000:00010000:3.0:1788612550.260735:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612550.497148:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612550.498476:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893400320 00000100:00100000:0.0:1788612550.498489:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893400320 00000100:00100000:0.0:1788612550.498586:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00100000:0.0:1788612550.498597:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:11298:x1875495893400320:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612550.498617:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612550.498642:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42076 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda86 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.498737:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4207d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.498760:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4207d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.498772:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4207d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.498831:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42084 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.499222:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42084 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.499230:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42084 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.499637:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af4208b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.499658:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af4208b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.499665:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af4208b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612550.499676:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00000100:00080000:3.0:1788612550.500162:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788612550.505035:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4207d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505054:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4207d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505062:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4207d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505067:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612550.505071:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4207d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505078:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4207d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505093:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff928ea7bbcc00) 00010000:00010000:0.0:1788612550.505096:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612550.505100:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4207d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505106:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4207d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505119:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42084 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505138:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42084 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505143:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42084 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505147:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612550.505150:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42084 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505157:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42084 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505164:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff928e91fbb900) 00010000:00010000:0.0:1788612550.505167:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612550.505170:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42084 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505176:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42084 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505616:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42076 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda86 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505632:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af4208b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda86 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.505641:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb600) 00010000:00010000:0.0:1788612550.505643:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612550.505652:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf600, rc 0) 00000100:00100000:0.0:1788612550.505740:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:11298:x1875495893400320:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 7143us (8601us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788612550.505749:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 137 00000100:00100000:1.0:1788612550.512980:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612550.513423:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893400448 00000100:00100000:0.0:1788612550.513435:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893400448 00000100:00100000:0.0:1788612550.513505:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:0.0:1788612550.513516:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0346d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:2356:x1875495893400448:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612550.513536:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612550.513559:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af4208b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda86 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612550.513579:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb600) 00010000:00010000:0.0:1788612550.513597:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612550.513659:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0346d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:2356:x1875495893400448:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 145us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612550.513667:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:3.0:1788612550.516787:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612550.516933:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893400576 00000100:00100000:1.0:1788612550.516946:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893400576 00000100:00100000:1.0:1788612550.517028:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 138 00000100:00100000:1.0:1788612550.517040:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:11298:x1875495893400576:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788612550.517183:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:11298:x1875495893400576:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 Request processed in 144us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612550.517208:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 138 00000100:00100000:3.0:1788612550.589153:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612550.589196:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612550.589244:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612550.589271:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893400960 00000100:00100000:3.0:1788612550.589279:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612550.589284:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893400960 00000100:00100000:3.0:1788612550.589313:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893401088 00000100:00100000:3.0:1788612550.589319:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893401088 00000100:00100000:1.0:1788612550.589354:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893400832 00000100:00100000:1.0:1788612550.589358:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893400832 00000100:00100000:3.0:1788612550.589367:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 150 00000100:00100000:3.0:1788612550.589381:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+6:2355:x1875495893401088:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612550.589388:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:1.0:1788612550.589399:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893400960:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612550.589453:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+6:2355:x1875495893401088:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 76us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612550.589462:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 150 00000100:00100000:0.0:1788612550.589485:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:3.0:1788612550.589491:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788612550.589499:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893400832:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612550.589501:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788612550.589586:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893400704 00000100:00100000:2.0:1788612550.589591:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893400704 00000100:00100000:2.0:1788612550.589617:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 293 00000100:00100000:2.0:1788612550.589624:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e91c4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893400704:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:3.0:1788612550.589709:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788612550.589716:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612550.589718:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612550.593911:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893400960:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 4498us (4698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612550.593927:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1788612550.594584:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893400832:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 5085us (5334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612550.595560:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:2.0:1788612550.596353:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e91c4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893400704:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 6725us (7205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612550.596364:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 293 00000100:00100000:3.0:1788612550.705468:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914378880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612550.705548:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612550.705652:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914378880 00000100:00100000:3.0:1788612550.705662:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914378880 00000100:00100000:3.0:1788612550.705708:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788612550.705717:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914378880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612550.705755:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612550.705800:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914378880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612550.705807:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788612550.705885:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914378880:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788612551.265868:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:1.0:1788612551.276092:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788612551.276104:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612551.276579:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788612551.276588:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788612551.279804:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788612552.300045:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788612552.300055:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612552.300450:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788612552.300458:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788612552.302782:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612552.861616:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612552.861747:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893401216 00000100:00100000:2.0:1788612552.861760:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893401216 00000100:00100000:2.0:1788612552.861827:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 139 00000100:00100000:2.0:1788612552.861858:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:11341:x1875495893401216:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612552.861881:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612552.861904:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af42099 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda8d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.861973:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.861989:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862028:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862045:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862052:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862058:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862280:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862289:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862295:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862301:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612552.862306:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862315:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862328:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928ea7bbc000) 00010000:00010000:2.0:1788612552.862331:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612552.862336:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862434:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862448:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862454:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862460:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862465:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612552.862468:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862474:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862482:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff928e9231d900) 00010000:00010000:2.0:1788612552.862485:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612552.862487:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862493:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862528:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af42099 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda8d expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862550:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928ea7bbc000) 00010000:00010000:2.0:1788612552.862553:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612552.862557:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af42099 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda8d expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.862567:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8e00, rc 0) 00000100:00100000:2.0:1788612552.862634:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:11341:x1875495893401216:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 797us (1044us total) trans 0 rc 301/301 00000100:00100000:2.0:1788612552.862643:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 139 00000100:00080000:2.0:1788612552.862677:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612552.872131:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612552.873055:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893401472 00000100:00100000:2.0:1788612552.873069:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893401472 00000100:00100000:3.0:1788612552.873575:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 140 00000100:00100000:3.0:1788612552.873595:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:11341:x1875495893401472:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:3.0:1788612552.873657:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612552.873684:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af41a17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8c6 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.873702:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928ea7bbc000) 00010000:00010000:3.0:1788612552.873707:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612552.876802:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.876834:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af4206f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda7f expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.877044:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.882568:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af4206f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda7f expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612552.882610:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af4206f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda7f expref: 5 pid: 5852 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612552.882633:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec03af100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914379008:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612552.882922:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a26780 going to sleep for 11 seconds 00000100:00100000:3.0:1788612552.887190:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612552.887227:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893401600 00000100:00100000:3.0:1788612552.887236:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893401600 00010000:00010000:3.0:1788612552.887290:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af4206f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda7f expref: 6 pid: 5852 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612552.887337:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:3.0:1788612552.887358:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78d21d21-8748-4720-b30a-c0081165c376+6:2356:x1875495893401600:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612552.887373:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612552.887381:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af4206f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda7f expref: 6 pid: 5852 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.887395:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af4206f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda7f expref: 6 pid: 5852 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.887419:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928ea7bbc000) 00010000:00010000:3.0:1788612552.887425:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.887434:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.887441:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.887472:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612552.887523:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78d21d21-8748-4720-b30a-c0081165c376+6:2356:x1875495893401600:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 168us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612552.887531:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00080000:3.0:1788612552.887552:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788612552.888015:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af4206f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda7f expref: 5 pid: 5852 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612552.888033:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec03af100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914379008:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612552.888058:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612552.888067:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612552.888080:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612552.888107:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af420b5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612552.888118:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af420b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612552.888126:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af420b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612552.891880:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788612552.891898:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612552.891910:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612552.891917:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612552.891923:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612552.891928:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612552.891935:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612552.891952:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928ea7bbc000) 00010000:00010000:1.0:1788612552.891955:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612552.891967:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612552.891974:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af420ae lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612552.891996:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007808e538 reply state 000000004a75d494 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af420b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612552.892019:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612552.892126:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:11341:x1875495893401472:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 18535us (20002us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788612552.892136:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 140 00010000:00010000:3.0:1788612552.896629:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af420b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.896648:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af420b5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.896656:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af420b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.896661:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612552.896666:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af420b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.896685:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af420b5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.896701:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff928e838cea00) 00010000:00010000:3.0:1788612552.896704:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612552.896709:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af420b5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612552.896715:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af420b5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612552.999574:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.000355:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893401728 00000100:00100000:2.0:1788612553.000367:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893401728 00000100:00100000:2.0:1788612553.000436:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 141 00000100:00100000:2.0:1788612553.000446:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:11349:x1875495893401728:12345-192.168.202.6@tcp:101:lctl.0 00010000:00010000:2.0:1788612553.000469:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612553.000494:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af420bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda94 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.000571:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af420c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.000585:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af420c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.000596:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af420c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612553.000640:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788612553.000644:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612553.000668:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af420c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.000692:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af420bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda94 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.000710:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af420c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda94 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.000718:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:2.0:1788612553.000721:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612553.000725:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9e00, rc 0) 00000100:00100000:2.0:1788612553.000788:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:11349:x1875495893401728:12345-192.168.202.6@tcp:101:lctl.0 Request processed in 342us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612553.000794:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 141 00000100:00100000:0.0:1788612553.046093:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612553.046335:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893401856 00000100:00100000:1.0:1788612553.046346:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893401856 00000100:00100000:1.0:1788612553.046413:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 142 00000100:00100000:1.0:1788612553.046424:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:11355:x1875495893401856:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1788612553.046446:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612553.046466:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af420ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dda9b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.046531:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af420d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.046547:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af420d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.046558:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af420d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.046573:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af420d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.046596:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af420d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.046666:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af420d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.046765:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af420df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.046773:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af420df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.046780:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af420df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612553.046808:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788612553.046811:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612553.050557:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af420df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.050583:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af420d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.050591:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af420d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.050599:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af420d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.050666:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612553.050671:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af420d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.050679:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af420d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.050698:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:3.0:1788612553.050701:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612553.050706:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af420d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.050712:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af420d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.050731:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af420d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.050738:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af420d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.050766:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af420d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.050771:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612553.050773:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af420d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.050780:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af420d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.050788:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff928e838ceb00) 00010000:00010000:3.0:1788612553.050791:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612553.050794:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af420d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.050799:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af420d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.051073:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af420ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda9b expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.051091:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af420df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda9b expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.051099:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:3.0:1788612553.051101:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788612553.051104:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61400, rc 0) 00000100:00100000:3.0:1788612553.051190:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:11355:x1875495893401856:12345-192.168.202.6@tcp:101:bash.0 Request processed in 4767us (5106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612553.051210:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 142 00000100:00100000:3.0:1788612553.054060:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.054200:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893402112 00000100:00100000:2.0:1788612553.054211:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893402112 00000100:00100000:2.0:1788612553.054290:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 143 00000100:00100000:2.0:1788612553.054300:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+15:11355:x1875495893402112:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1788612553.054321:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612553.054354:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af420e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddaa2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.054483:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420ed lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.054499:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.054512:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.054569:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.054578:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.054585:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788612553.055446:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788612553.056419:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af420fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.056439:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af420fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.056451:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af420fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.056512:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.056519:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420ed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.056526:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.056532:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612553.056536:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.056544:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.056556:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:2.0:1788612553.056559:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612553.056564:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.056570:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af420ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612553.056585:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8be8ecf reply state 00000000d1089e6a transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612553.056594:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788612553.057117:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af420e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa2 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.057153:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af420fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa2 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.057162:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231d800) 00010000:00010000:2.0:1788612553.057165:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612553.057168:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0145c00, rc 0) 00000100:00100000:2.0:1788612553.057313:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:11355:x1875495893402112:12345-192.168.202.6@tcp:101:bash.0 Request processed in 3014us (3264us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788612553.057323:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 143 00000100:00100000:0.0:1788612553.061211:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612553.061283:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893402240 00000100:00100000:3.0:1788612553.061294:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893402240 00000100:00100000:3.0:1788612553.061375:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:3.0:1788612553.061388:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2354:x1875495893402240:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1788612553.061406:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612553.061428:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006931fb73/0xfc956d548af42109 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddaa9 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612553.061457:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788612553.061476:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1788612553.061480:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612553.061488:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006931fb73/0xfc956d548af42109 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa9 expref: 6 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.061506:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006931fb73/0xfc956d548af42109 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa9 expref: 6 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.061520:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030000, rc 0) 00000100:00100000:3.0:1788612553.061578:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2354:x1875495893402240:12345-192.168.202.6@tcp:101:bash.0 Request processed in 193us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612553.061584:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00080000:0.0:1788612553.062101:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612553.064623:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:1.0:1788612553.064787:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.064800:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.064807:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.064812:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612553.064817:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.064824:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.064882:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928e9231d700) 00010000:00010000:1.0:1788612553.064885:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612553.064890:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.064896:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af420f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612553.065027:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893402368 00000100:00100000:3.0:1788612553.065037:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893402368 00000100:00100000:3.0:1788612553.065096:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:3.0:1788612553.065113:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:11355:x1875495893402368:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1788612553.065133:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612553.065153:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddab0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.065184:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006931fb73/0xfc956d548af42109 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa9 expref: 7 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.065193:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612553.065198:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612553.065203:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.065248:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006931fb73/0xfc956d548af42109 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa9 expref: 7 pid: 8463 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.065263:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006931fb73/0xfc956d548af42109 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa9 expref: 7 pid: 8463 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612553.065278:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec07ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875495914379136:192.168.202.6@tcp:104: 00000100:00100000:3.0:1788612553.065369:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e811ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1788612553.067481:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec07ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875495914379136:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612553.067526:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.067552:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030600, rc 0) 00000100:00100000:1.0:1788612553.067630:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:11355:x1875495893402368:12345-192.168.202.6@tcp:101:bash.0 Request processed in 2518us (3025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612553.067640:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:0.0:1788612553.070487:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612553.070721:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893402496 00000100:00100000:3.0:1788612553.070733:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893402496 00010000:00010000:3.0:1788612553.070779:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006931fb73/0xfc956d548af42109 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa9 expref: 7 pid: 8463 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612553.070881:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:3.0:1788612553.070892:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2356:x1875495893402496:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612553.070909:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612553.070934:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006931fb73/0xfc956d548af42109 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa9 expref: 7 pid: 8463 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.070948:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006931fb73/0xfc956d548af42109 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa9 expref: 7 pid: 8463 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.070969:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006931fb73/0xfc956d548af42109 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa9 expref: 7 pid: 8463 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.070986:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612553.070990:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612553.070998:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.071027:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.071068:0:11669:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612553.071083:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec07dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11669:1875495914379264:192.168.202.6@tcp:105: 00000100:00100000:3.0:1788612553.071165:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e811ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1788612553.075205:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.075280:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893402752 00000100:00100000:2.0:1788612553.075292:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893402752 00000100:00100000:2.0:1788612553.075359:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:2.0:1788612553.075369:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:11355:x1875495893402752:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:2.0:1788612553.075952:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:11355:x1875495893402752:12345-192.168.202.6@tcp:35:bash.0 Request processed in 582us (756us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788612553.075961:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:3.0:1788612553.076068:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec07dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11669:1875495914379264:192.168.202.6@tcp:105: 00010000:00010000:3.0:1788612553.076091:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612553.076115:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893402496:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 5225us (5640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612553.076123:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:0.0:1788612553.162013:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.162135:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893403008 00000100:00100000:2.0:1788612553.162145:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893403008 00000100:00100000:2.0:1788612553.162206:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 144 00000100:00100000:2.0:1788612553.162216:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:11365:x1875495893403008:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612553.162243:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612553.162269:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42117 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddab7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612553.162369:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788612553.162497:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42117 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab7 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.162512:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:2.0:1788612553.162515:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612553.162520:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42117 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab7 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.162534:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8c00, rc 0) 00000100:00100000:2.0:1788612553.162602:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:11365:x1875495893403008:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 387us (610us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788612553.162618:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 144 00000100:00100000:0.0:1788612553.166818:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.167145:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893403264 00000100:00100000:2.0:1788612553.167157:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893403264 00000100:00100000:2.0:1788612553.167216:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:2.0:1788612553.167225:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:11365:x1875495893403264:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1788612553.167493:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:11365:x1875495893403264:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 268us (685us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788612553.167501:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:0.0:1788612553.283049:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.283147:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893403392 00000100:00100000:2.0:1788612553.283157:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893403392 00000100:00100000:2.0:1788612553.283217:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 145 00000100:00100000:2.0:1788612553.283227:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:11371:x1875495893403392:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612553.283251:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612553.283273:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42125 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddabe expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.283357:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4212c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.283371:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4212c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.283385:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4212c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612553.283418:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788612553.283421:0:8316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612553.283440:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4212c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.283465:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42125 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddabe expref: 22 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.283484:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4212c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddabe expref: 21 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.283493:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:2.0:1788612553.283495:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612553.283498:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8e00, rc 0) 00000100:00100000:2.0:1788612553.283557:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:11371:x1875495893403392:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 332us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612553.283564:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 145 00000100:00100000:3.0:1788612553.292942:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.293103:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893403648 00000100:00100000:2.0:1788612553.293113:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893403648 00000100:00100000:2.0:1788612553.293185:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 146 00000100:00100000:2.0:1788612553.293196:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:11371:x1875495893403648:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612553.293215:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612553.293235:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42133 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddac5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.293336:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af4213a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.293360:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af4213a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.293372:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af4213a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612553.293384:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788612553.293531:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42133 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddac5 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.293550:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af4213a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddac5 expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.293558:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231d800) 00010000:00010000:2.0:1788612553.293561:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612553.293564:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9a00, rc 0) 00000100:00100000:2.0:1788612553.293653:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+23:11371:x1875495893403648:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 458us (721us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788612553.293660:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 146 00000100:00100000:0.0:1788612553.305754:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.305862:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893403904 00000100:00100000:2.0:1788612553.305886:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893403904 00000100:00100000:2.0:1788612553.305955:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 147 00000100:00100000:2.0:1788612553.305965:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+23:11371:x1875495893403904:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612553.305987:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612553.306015:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42148 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddacc expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.306122:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13000/0xfc956d548af4214f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.306139:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13000/0xfc956d548af4214f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.306152:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13000/0xfc956d548af4214f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612553.306165:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788612553.306278:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42148 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddacc expref: 26 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.306297:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13000/0xfc956d548af4214f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddacc expref: 25 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.306306:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231d800) 00010000:00010000:2.0:1788612553.306309:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788612553.306312:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd13000, rc 0) 00000100:00100000:2.0:1788612553.306378:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+25:11371:x1875495893403904:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 414us (631us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788612553.306385:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 147 00000100:00100000:0.0:1788612553.316820:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612553.317048:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893404032 00000100:00100000:3.0:1788612553.317059:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893404032 00000100:00100000:3.0:1788612553.317134:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:3.0:1788612553.317146:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+25:2355:x1875495893404032:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612553.317163:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612553.317190:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af4213a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddac5 expref: 25 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.317210:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231d800) 00010000:00010000:3.0:1788612553.317216:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612553.317283:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+24:2355:x1875495893404032:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 139us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612553.317290:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:0.0:1788612553.327810:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612553.327920:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893404160 00000100:00100000:1.0:1788612553.327931:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893404160 00000100:00100000:1.0:1788612553.327991:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:1.0:1788612553.328000:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893404160:12345-192.168.202.6@tcp:1:lfs.0 00010000:00010000:1.0:1788612553.328056:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090eeffe0/0xfc956d548af4215d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.328079:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.328107:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788612553.328112:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612553.328117:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090eeffe0/0xfc956d548af4215d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.328153:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.328168:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 6 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612553.328182:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0345500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875495914379392:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612553.328275:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91082540 going to sleep for 11 seconds 00010000:00010000:3.0:1788612553.330961:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612553.331400:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0345500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875495914379392:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612553.331439:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000090eeffe0/0xfc956d548af4215d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612553.333250:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.333668:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893404288 00000100:00100000:2.0:1788612553.333679:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893404288 00002000:00100000:2.0:1788612553.333737:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff928ebfc35880 x1875495893404288/t0(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:199/0 lens 504/0 e 0 to 0 dl 1788612564 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788612553.333749:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928ebfc35880 with x1875495893404288 ext(0->12) 00010000:00010000:2.0:1788612553.333759:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 7 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.333775:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 7 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612553.333783:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff928ebfc35880 00000100:00100000:2.0:1788612553.333821:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:2.0:1788612553.333868:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2355:x1875495893404288:12345-192.168.202.6@tcp:4:lfs.0 00000100:00100000:3.0:1788612553.335324:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2355:x1875495893404288:12345-192.168.202.6@tcp:4:lfs.0 Request processed in 1475us (2074us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788612553.335339:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00002000:00100000:3.0:1788612553.336107:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff928ebfc35880 x1875495893404288/t4294967305(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:199/0 lens 504/448 e 0 to 0 dl 1788612564 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612553.336142:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928ebfc35880 with x1875495893404288 ext(0->12) 00010000:00010000:3.0:1788612553.336155:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.336173:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612553.336181:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff928ebfc35880 00000100:00100000:0.0:1788612553.338545:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612553.340421:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893404416 00000100:00100000:1.0:1788612553.340436:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893404416 00010000:00010000:1.0:1788612553.340487:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612553.340539:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:1.0:1788612553.340548:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2354:x1875495893404416:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612553.340581:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788612553.340614:0:5837:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788612553.340618:0:5837:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788612553 00002000:00010000:1.0:1788612553.340621:0:5837:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788612553 00002000:00010000:1.0:1788612553.340623:0:5837:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788612553 00010000:00010000:1.0:1788612553.340630:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.340645:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.340669:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42110 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddab0 expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.340686:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612553.340691:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612553.340697:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090eeffe0/0xfc956d548af4215d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.340706:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090eeffe0/0xfc956d548af4215d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.340746:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612553.340808:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2354:x1875495893404416:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 261us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612553.340816:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00010000:00010000:2.0:1788612553.342280:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000090eeffe0/0xfc956d548af4215d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.342297:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090eeffe0/0xfc956d548af4215d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.342331:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090eeffe0/0xfc956d548af4215d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.342339:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090eeffe0/0xfc956d548af4215d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.342364:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090eeffe0/0xfc956d548af4215d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.342370:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612553.342374:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090eeffe0/0xfc956d548af4215d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.342384:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090eeffe0/0xfc956d548af4215d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.342401:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090eeffe0/0xfc956d548af4215d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.342408:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090eeffe0/0xfc956d548af4215d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612553.342484:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2355:x1875495893404160:12345-192.168.202.6@tcp:1:lfs.0 Request processed in 14482us (14680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612553.342493:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:0.0:1788612553.347817:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.348033:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893404672 00000100:00100000:2.0:1788612553.348045:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893404672 00000100:00100000:2.0:1788612553.348096:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:2.0:1788612553.348107:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e8347c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+24:11371:x1875495893404672:12345-192.168.202.6@tcp:35:lfs.0 00000004:00010000:2.0:1788612553.348172:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13000/0xfc956d548af4214f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddacc expref: 24 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788612553.348439:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788612553.348484:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788612553.349504:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788612553.350288:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.350309:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af420fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa2 expref: 28 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.350318:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.350373:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af420fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa2 expref: 28 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.350391:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af420fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa2 expref: 28 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612553.350404:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec03ace00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1875495914379520:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612553.350509:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a26780 going to sleep for 11 seconds 00000100:00100000:1.0:1788612553.356657:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612553.357282:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893404800 00000100:00100000:3.0:1788612553.357469:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893404800 00010000:00010000:3.0:1788612553.357529:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af420fb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa2 expref: 29 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612553.357566:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:3.0:1788612553.357756:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9238cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+29:2356:x1875495893404800:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612553.357774:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612553.357781:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af420fb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa2 expref: 29 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.357794:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af420fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa2 expref: 29 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.357816:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231d800) 00010000:00010000:3.0:1788612553.357821:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.357983:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.357992:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.358025:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612553.358085:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9238cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+29:2356:x1875495893404800:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 510us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612553.358094:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00010000:00010000:2.0:1788612553.360149:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af420fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaa2 expref: 28 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612553.360175:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec03ace00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1875495914379520:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612553.360202:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.360235:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.360241:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788612553.360825:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788612553.361221:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788612553.361824:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec03ace00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875495914379648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788612553.362118:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612553.362198:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e932a7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612553.362249:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914379648 00000100:00100000:1.0:1788612553.362256:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914379648 00000100:00100000:1.0:1788612553.362368:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788612553.362379:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875495914379648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788612553.362464:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875495914379648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612553.362471:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788612553.362556:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec03ace00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875495914379648:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788612553.363089:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788612553.363159:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec07de300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875495914379776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788612553.363190:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612553.363219:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a26780 going to sleep for 11 seconds 00000100:00100000:1.0:1788612553.363347:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914379776 00000100:00100000:1.0:1788612553.363353:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914379776 00000100:00100000:1.0:1788612553.363377:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612553.363383:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875495914379776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788612553.363534:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1875495914379776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 150us (342us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788612553.363540:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788612553.363726:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec07de300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875495914379776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788612553.363774:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788612553.363812:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.363821:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.363860:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.363879:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612553.363884:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.363892:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.363907:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231d800) 00010000:00010000:3.0:1788612553.363910:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788612553.363914:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.363922:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af42164 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788612553.364094:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788612553.364193:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788612553.364204:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347207365374ns, next at 348207363584ns, rc = 0 00000001:00080000:3.0:1788612553.364210:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788612553.364240:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231d800) 00010000:00010000:3.0:1788612553.364242:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788612553.364249:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13000/0xfc956d548af4214f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddacc expref: 32 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612553.364355:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e8347c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+31:11371:x1875495893404672:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 16250us (16548us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788612553.364363:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00000020:00080000:3.0:1788612553.364367:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1788612553.367288:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612553.367399:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.367528:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893404928 00000100:00100000:2.0:1788612553.367538:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893404928 00000100:00100000:2.0:1788612553.367749:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 148 00000100:00100000:2.0:1788612553.367760:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+31:11371:x1875495893404928:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612553.367786:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612553.367810:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4216b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddad3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.367908:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4216b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddad3 expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.367923:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4216b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddad3 expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.367942:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:2.0:1788612553.367945:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788612553.367949:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd13e00, rc 0) 00000100:00100000:2.0:1788612553.368013:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+32:11371:x1875495893404928:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 247us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612553.368034:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 148 00000100:00100000:1.0:1788612553.376779:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612553.377100:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893405184 00000100:00100000:0.0:1788612553.377111:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893405184 00000100:00100000:0.0:1788612553.377175:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:0.0:1788612553.377185:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+32:11371:x1875495893405184:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:0.0:1788612553.377428:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+33:11371:x1875495893405184:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 243us (660us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1788612553.377435:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:1.0:1788612553.498487:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.498625:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893405440 00000100:00100000:2.0:1788612553.498637:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893405440 00000100:00100000:2.0:1788612553.498704:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 149 00000100:00100000:2.0:1788612553.498716:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+33:11381:x1875495893405440:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612553.498745:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612553.498769:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42172 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddada expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612553.499108:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788612553.499239:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42172 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddada expref: 35 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.499254:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:2.0:1788612553.499257:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612553.499262:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42172 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddada expref: 35 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.499275:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd13400, rc 0) 00000100:00100000:2.0:1788612553.499379:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+34:11381:x1875495893405440:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 666us (909us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788612553.499386:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 149 00000100:00100000:3.0:1788612553.504436:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612553.504535:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893405568 00000100:00100000:0.0:1788612553.504546:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893405568 00000100:00100000:0.0:1788612553.504609:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 150 00000100:00100000:0.0:1788612553.504627:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+34:11381:x1875495893405568:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:0.0:1788612553.504724:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af42180 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.504741:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af42180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.504773:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af42180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.504789:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.504795:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.504801:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.504939:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4218e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.504948:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4218e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.504954:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4218e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788612553.504998:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4218e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505041:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af42180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505048:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af42180 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505054:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af42180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505070:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612553.505075:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af42180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505083:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af42180 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505097:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:0.0:1788612553.505101:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612553.505106:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af42180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505112:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af42180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505127:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505133:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42187 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505138:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505143:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612553.505146:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505151:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505169:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928e91fbb900) 00010000:00010000:0.0:1788612553.505171:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612553.505174:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42187 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505179:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af42187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505194:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4218e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505200:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4218e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505205:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4218e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505210:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612553.505212:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4218e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505218:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4218e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505225:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:0.0:1788612553.505227:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612553.505230:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4218e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.505236:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af4218e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612553.505313:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+34:11381:x1875495893405568:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 686us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612553.505321:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 150 00000100:00100000:1.0:1788612553.509146:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612553.509240:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893405824 00000100:00100000:3.0:1788612553.509251:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893405824 00000100:00100000:3.0:1788612553.509315:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:3.0:1788612553.509325:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+34:11381:x1875495893405824:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1788612553.509602:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+35:11381:x1875495893405824:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 276us (465us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788612553.510456:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:1.0:1788612553.553563:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.553868:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893406080 00000100:00100000:2.0:1788612553.553879:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893406080 00000100:00100000:2.0:1788612553.553946:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 151 00000100:00100000:2.0:1788612553.553958:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+35:11384:x1875495893406080:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612553.554019:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612553.554045:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42195 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddae1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554122:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af4219c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554139:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af4219c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554151:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af4219c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554164:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af421a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554171:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af421a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554176:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af421a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554293:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af421aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554302:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af421aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554309:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af421aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612553.554318:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788612553.554422:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af4219c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554430:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af4219c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554436:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af4219c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554442:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612553.554446:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af4219c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554454:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af4219c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554468:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:2.0:1788612553.554471:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612553.554476:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af4219c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554483:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af4219c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554496:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af421a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554502:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af421a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554508:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af421a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554523:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612553.554526:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af421a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554532:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af421a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554540:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928e9231de00) 00010000:00010000:2.0:1788612553.554542:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612553.554545:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af421a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554551:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af421a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.554599:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42195 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddae1 expref: 38 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.555188:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af421aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddae1 expref: 37 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.555198:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:2.0:1788612553.555200:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612553.555202:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd12a00, rc 0) 00000100:00100000:2.0:1788612553.555289:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+37:11384:x1875495893406080:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1333us (1737us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788612553.555298:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 151 00000100:00100000:1.0:1788612553.561422:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612553.561522:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893406208 00000100:00100000:0.0:1788612553.561534:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893406208 00000100:00100000:0.0:1788612553.561606:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 152 00000100:00100000:0.0:1788612553.561763:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+37:11384:x1875495893406208:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:0.0:1788612553.561920:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af421b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.561939:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af421b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.561952:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af421b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.561980:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af421b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.561987:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af421b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.561995:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af421b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.562001:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612553.562016:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af421b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.562025:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af421b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.562053:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:0.0:1788612553.562056:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612553.562061:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af421b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.562067:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af421b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612553.562145:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+37:11384:x1875495893406208:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 386us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612553.562153:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 152 00000100:00100000:1.0:1788612553.565479:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.566452:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893406464 00000100:00100000:2.0:1788612553.566480:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893406464 00000100:00100000:2.0:1788612553.566579:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:2.0:1788612553.566591:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+37:11384:x1875495893406464:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1788612553.566860:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+38:11384:x1875495893406464:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 270us (1392us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788612553.566869:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:1.0:1788612553.866790:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612553.866938:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893406720 00000100:00100000:1.0:1788612553.866949:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893406720 00000100:00100000:1.0:1788612553.867003:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 153 00000100:00100000:1.0:1788612553.867022:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+38:11415:x1875495893406720:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:1.0:1788612553.867061:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612553.867083:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af421bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddae8 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.867179:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af421c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.867194:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af421c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.867207:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af421c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612553.867218:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788612553.867343:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af421bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddae8 expref: 41 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.867374:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af421c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddae8 expref: 40 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.867384:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:1.0:1788612553.867387:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612553.867390:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61800, rc 0) 00000100:00100000:1.0:1788612553.867447:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+40:11415:x1875495893406720:12345-192.168.202.6@tcp:101:cat.0 Request processed in 435us (667us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788612553.867454:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 153 00000100:00100000:1.0:1788612553.871772:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612553.871873:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612553.871903:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893407104 00000100:00100000:1.0:1788612553.871923:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893407104 00000100:00100000:1.0:1788612553.871983:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1788612553.871993:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+40:2356:x1875495893407104:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612553.872020:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612553.872045:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af421c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddae8 expref: 40 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.872062:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:1.0:1788612553.872067:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612553.872116:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+39:2356:x1875495893407104:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 125us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612553.872123:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000001:00080000:2.0:1788612553.872604:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1788612553.872629:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:3.0:1788612553.872775:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893406976 00000100:00100000:3.0:1788612553.872780:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893406976 00000100:00100000:3.0:1788612553.872823:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:3.0:1788612553.872867:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+39:11415:x1875495893406976:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:3.0:1788612553.873100:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+40:11415:x1875495893406976:12345-192.168.202.6@tcp:35:cat.0 Request processed in 235us (1337us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788612553.873107:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:1.0:1788612553.971329:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612553.971427:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893407360 00000100:00100000:2.0:1788612553.971436:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893407360 00000100:00100000:2.0:1788612553.971495:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 154 00000100:00100000:2.0:1788612553.971504:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+40:11421:x1875495893407360:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1788612553.971529:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612553.971532:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788612553.971554:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af4212c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddabe expref: 40 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.971574:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:2.0:1788612553.971588:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612553.971609:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af421d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddaef expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.971708:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.971720:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af421aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddae1 expref: 40 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.971746:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.971780:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af421aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddae1 expref: 40 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612553.971792:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af421aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddae1 expref: 40 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612553.971805:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec03af480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914379904:192.168.202.6@tcp:104: 00000100:00100000:3.0:1788612553.972488:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90aae9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612553.981002:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec03af480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914379904:192.168.202.6@tcp:104: 00010000:00010000:3.0:1788612553.981047:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612553.981563:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612553.981797:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893407488 00000100:00100000:3.0:1788612553.981803:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893407488 00010000:00010000:3.0:1788612553.981875:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af421aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddae1 expref: 41 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612553.981905:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:3.0:1788612553.981912:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0303100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+41:2356:x1875495893407488:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612553.981939:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612553.981946:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af421aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddae1 expref: 41 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.981958:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af421aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddae1 expref: 41 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.981983:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af421aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddae1 expref: 41 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.982002:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:3.0:1788612553.982007:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.982026:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.982034:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.982065:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612553.982126:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0303100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+40:2356:x1875495893407488:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 213us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612553.982134:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00010000:00010000:1.0:1788612553.982811:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.982822:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612553.982890:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788612553.983062:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af421d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaef expref: 41 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.983080:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaef expref: 40 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612553.983087:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:1.0:1788612553.983099:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788612553.983102:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd13a00, rc 0) 00000100:00100000:1.0:1788612553.983152:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+40:11421:x1875495893407360:12345-192.168.202.6@tcp:101:dd.0 Request processed in 11649us (11835us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788612553.983160:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 154 00000100:00100000:1.0:1788612553.987169:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612553.987255:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893407744 00000100:00100000:0.0:1788612553.987267:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893407744 00000100:00100000:0.0:1788612553.987330:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 155 00000100:00100000:0.0:1788612553.987342:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+40:11421:x1875495893407744:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:0.0:1788612553.987646:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af421e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.987663:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af421e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612553.987672:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af421e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612553.987717:0:8316:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788612553.987733:0:8316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9da4714 reply state 000000001c3ec1de transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af421e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612553.987739:0:8316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612553.987863:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+43:11421:x1875495893407744:12345-192.168.202.6@tcp:36:dd.0 Request processed in 524us (706us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788612553.987875:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 155 00000020:00080000:0.0:1788612553.987879:0:8316:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788612553.995768:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af421e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.995786:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af421e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.995814:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af421e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.995820:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612553.995825:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af421e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.995833:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af421e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.995880:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:3.0:1788612553.995883:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612553.995888:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af421e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612553.995896:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af421e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612554.323931:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612554.324062:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893407872 00000100:00100000:0.0:1788612554.324073:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893407872 00000100:00100000:0.0:1788612554.324198:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 156 00000100:00100000:0.0:1788612554.324209:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+42:11435:x1875495893407872:12345-192.168.202.6@tcp:101:stat.0 00010000:00010000:0.0:1788612554.324233:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612554.324255:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af421f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddaf6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.324319:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af421f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.324334:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af421f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.324348:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af421f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.324362:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af421fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.324369:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af421fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.325613:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af421fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.325721:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af42205 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.325750:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaef expref: 43 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.325760:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af42205 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.325798:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaef expref: 43 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.325815:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaef expref: 43 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612554.325831:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc37100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914380032:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612554.326085:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacc40b40 going to sleep for 11 seconds 00000100:00080000:3.0:1788612554.326569:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612554.328658:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612554.328878:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893408128 00000100:00100000:3.0:1788612554.328889:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893408128 00000100:00100000:3.0:1788612554.328954:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:3.0:1788612554.328965:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+44:5594:x1875495893408128:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788612554.329630:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+45:5594:x1875495893408128:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 665us (981us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788612554.329640:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:2.0:1788612554.333460:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612554.333554:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893408256 00000100:00100000:1.0:1788612554.333564:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893408256 00010000:00010000:1.0:1788612554.333602:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaef expref: 45 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612554.333652:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:1.0:1788612554.333662:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+45:2356:x1875495893408256:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612554.333676:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612554.333683:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaef expref: 45 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.333698:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaef expref: 45 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.333720:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:1.0:1788612554.333726:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af42205 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.333737:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af42205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.333743:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af42205 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.333772:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612554.333875:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+45:2356:x1875495893408256:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 214us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612554.333883:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00010000:00010000:0.0:1788612554.335257:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af421db lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaef expref: 44 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612554.335289:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc37100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914380032:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612554.335317:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af42205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335326:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af42205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335332:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af42205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612554.335403:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788612554.335422:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612554.335450:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af42205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335466:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af42205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335476:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af421f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335482:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af421f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335488:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af421f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335493:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612554.335497:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af421f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335503:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af421f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335516:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:0.0:1788612554.335519:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612554.335523:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af421f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335529:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af421f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335540:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af421fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335555:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af421fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335560:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af421fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335564:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdea00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612554.335567:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af421fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335573:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af421fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335580:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928e91fbbf00) 00010000:00010000:0.0:1788612554.335582:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612554.335585:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af421fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335591:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af421fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335751:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af421f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaf6 expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335765:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af42205 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaf6 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.335773:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:0.0:1788612554.335775:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612554.335783:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdfa00, rc 0) 00000100:00100000:0.0:1788612554.335879:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+43:11435:x1875495893407872:12345-192.168.202.6@tcp:101:stat.0 Request processed in 11628us (11914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612554.335889:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 156 00010000:00010000:3.0:1788612554.348935:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612554.412419:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612554.412491:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893408512 00000100:00100000:0.0:1788612554.412502:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893408512 00000100:00100000:0.0:1788612554.412563:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 157 00000100:00100000:0.0:1788612554.412573:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+43:11441:x1875495893408512:12345-192.168.202.6@tcp:36:truncate.0 00010000:00010000:0.0:1788612554.412637:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612554.412666:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af42205 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddaf6 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.412686:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:0.0:1788612554.412692:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612554.412918:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4220c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.412932:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4220c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.412941:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4220c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612554.412992:0:8316:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788612554.413038:0:8316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e70dc86 reply state 000000003b17c96e transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4220c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612554.413046:0:8316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612554.413144:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+45:11441:x1875495893408512:12345-192.168.202.6@tcp:36:truncate.0 Request processed in 572us (735us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788612554.413169:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 157 00000020:00080000:0.0:1788612554.413174:0:8316:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788612554.415050:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4220c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.415066:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4220c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.415073:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4220c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.415078:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612554.415083:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4220c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.415091:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4220c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.415107:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:1.0:1788612554.415110:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612554.415115:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4220c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.415122:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde800/0xfc956d548af4220c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612554.555640:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612554.555712:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893408640 00000100:00100000:3.0:1788612554.555722:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893408640 00000100:00100000:3.0:1788612554.555788:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 158 00000100:00100000:3.0:1788612554.555800:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+44:11455:x1875495893408640:12345-192.168.202.6@tcp:101:stat.0 00010000:00010000:3.0:1788612554.555823:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612554.555894:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42213 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddafd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.555961:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4221a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.555975:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4221a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.555987:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4221a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556001:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556008:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556027:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556115:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42228 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556123:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556130:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612554.556173:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788612554.556177:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612554.556197:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556208:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556216:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4221a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556222:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4221a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556229:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4221a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556234:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612554.556238:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4221a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556244:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4221a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556256:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:3.0:1788612554.556259:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612554.556264:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4221a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556270:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4221a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556294:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556300:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42221 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556306:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556311:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612554.556313:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556319:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42221 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556325:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928ea7bbc800) 00010000:00010000:3.0:1788612554.556327:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612554.556329:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42221 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556335:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42221 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556363:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42213 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddafd expref: 46 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556376:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddafd expref: 45 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.556393:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:3.0:1788612554.556396:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612554.556399:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030600, rc 0) 00000100:00100000:3.0:1788612554.556468:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+45:11455:x1875495893408640:12345-192.168.202.6@tcp:101:stat.0 Request processed in 671us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612554.556475:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 158 00000100:00100000:2.0:1788612554.666328:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612554.666481:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893408896 00000100:00100000:1.0:1788612554.666493:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893408896 00000100:00100000:1.0:1788612554.666557:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 159 00000100:00100000:1.0:1788612554.666568:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+45:11464:x1875495893408896:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1788612554.666590:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612554.666611:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af4222f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb04 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612554.666710:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788612554.666883:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af4222f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb04 expref: 47 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.666899:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:1.0:1788612554.666901:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612554.666907:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af4222f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb04 expref: 47 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.666922:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60200, rc 0) 00000100:00100000:1.0:1788612554.666985:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+46:11464:x1875495893408896:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 419us (672us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788612554.666992:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 159 00000100:00100000:2.0:1788612554.675648:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612554.675742:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893409152 00000100:00100000:1.0:1788612554.675754:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893409152 00000100:00100000:1.0:1788612554.675811:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:1.0:1788612554.675820:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e8347e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+46:11464:x1875495893409152:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1788612554.676115:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e8347e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+47:11464:x1875495893409152:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 294us (476us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788612554.676140:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:3.0:1788612554.726046:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612554.726159:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893409408 00000100:00100000:1.0:1788612554.726170:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893409408 00000100:00100000:1.0:1788612554.726231:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 160 00000100:00100000:1.0:1788612554.726243:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+47:11471:x1875495893409408:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1788612554.726267:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612554.726288:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af4223d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb0b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.726401:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.726416:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42228 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddafd expref: 48 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.726425:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.726462:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddafd expref: 48 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.726476:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42228 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddafd expref: 48 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612554.726489:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914380160:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612554.726584:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91082b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612554.729004:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914380160:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612554.729060:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612554.730554:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612554.730664:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893409536 00000100:00100000:0.0:1788612554.730673:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893409536 00010000:00010000:0.0:1788612554.730717:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42228 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddafd expref: 49 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612554.730760:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:0.0:1788612554.730770:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+49:2356:x1875495893409536:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612554.730783:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612554.730789:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42228 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddafd expref: 49 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.730800:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddafd expref: 49 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.730820:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42228 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddafd expref: 49 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.730879:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:0.0:1788612554.730884:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.730893:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.730900:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.730945:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612554.731005:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+48:2356:x1875495893409536:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 236us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612554.731012:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00010000:00010000:1.0:1788612554.731228:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.731237:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612554.731256:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788612554.731407:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af4223d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb0b expref: 49 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.731424:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb0b expref: 48 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.731431:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:1.0:1788612554.731434:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788612554.731436:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61800, rc 0) 00000100:00100000:1.0:1788612554.731476:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+48:11471:x1875495893409408:12345-192.168.202.6@tcp:101:bash.0 Request processed in 5235us (5441us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788612554.731484:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 160 00000100:00100000:3.0:1788612554.735226:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612554.735337:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893409792 00000100:00100000:1.0:1788612554.735347:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893409792 00000100:00100000:1.0:1788612554.735409:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 161 00000100:00100000:1.0:1788612554.735418:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+48:11471:x1875495893409792:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:1.0:1788612554.735715:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af42252 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.735748:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af42252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.735762:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af42252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788612554.735817:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1788612554.735859:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2d7cbbb reply state 000000005cd4f88d transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af42252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612554.735869:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612554.735961:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+51:11471:x1875495893409792:12345-192.168.202.6@tcp:36:bash.0 Request processed in 542us (743us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788612554.735968:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 161 00000020:00080000:1.0:1788612554.735973:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788612554.737989:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af42252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.738005:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af42252 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.738012:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af42252 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.738027:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612554.738032:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af42252 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.738041:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af42252 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.738055:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:0.0:1788612554.738058:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612554.738063:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af42252 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.738069:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af42252 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612554.743226:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612554.743494:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893409920 00000100:00100000:0.0:1788612554.743504:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893409920 00000100:00100000:0.0:1788612554.743581:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 162 00000100:00100000:0.0:1788612554.743591:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+50:11471:x1875495893409920:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1788612554.743615:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612554.743644:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af42259 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb12 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.743729:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.743743:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb0b expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.743752:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42260 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.743788:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb0b expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.743803:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb0b expref: 51 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612554.743816:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc37100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914380288:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612554.743934:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacc406c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612554.746419:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc37100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914380288:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612554.746454:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612554.748027:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612554.748263:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893410048 00000100:00100000:1.0:1788612554.748272:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893410048 00010000:00010000:1.0:1788612554.748311:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb0b expref: 52 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612554.748348:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:1.0:1788612554.748369:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:2355:x1875495893410048:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612554.748384:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612554.748391:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb0b expref: 52 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.748404:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb0b expref: 52 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.748444:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42244 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb0b expref: 52 pid: 5854 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.748460:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:1.0:1788612554.748465:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.748474:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.748482:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42260 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.748509:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612554.748562:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+51:2355:x1875495893410048:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 206us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612554.748570:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00010000:00010000:0.0:1788612554.748738:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.748753:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612554.748800:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788612554.748804:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612554.748823:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.748881:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af42259 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb12 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.748896:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb12 expref: 50 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612554.748902:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:0.0:1788612554.748905:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612554.748907:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdea00, rc 0) 00000100:00100000:0.0:1788612554.748931:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+50:11471:x1875495893409920:12345-192.168.202.6@tcp:101:bash.0 Request processed in 5343us (5721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612554.748938:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 162 00000100:00100000:2.0:1788612554.752580:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612554.752713:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893410304 00000100:00100000:3.0:1788612554.752723:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893410304 00000100:00100000:3.0:1788612554.752786:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:3.0:1788612554.752797:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+50:11471:x1875495893410304:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:3.0:1788612554.753071:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+51:11471:x1875495893410304:12345-192.168.202.6@tcp:35:bash.0 Request processed in 276us (501us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788612554.753079:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00000004:00080000:3.0:1788612554.796223:0:7004:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348639382640ns, next at 349639380450ns, rc = 0 00000100:00100000:2.0:1788612554.796407:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec07dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914380416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612554.796475:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612554.801924:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914380416 00000100:00100000:1.0:1788612554.801943:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914380416 00000100:00100000:1.0:1788612554.802085:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788612554.802097:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914380416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612554.802139:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788612554.802232:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914380416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (5756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612554.802239:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788612554.802321:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1788612554.802328:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1788612554.802367:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec07dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914380416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612554.856728:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612554.856873:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893410560 00000100:00100000:1.0:1788612554.856886:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893410560 00000100:00100000:1.0:1788612554.856971:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 163 00000100:00100000:1.0:1788612554.856982:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+51:11481:x1875495893410560:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1788612554.857006:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612554.857038:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42267 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb19 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612554.857140:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788612554.857267:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42267 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb19 expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.857281:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:1.0:1788612554.857284:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612554.857290:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42267 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb19 expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.857305:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61800, rc 0) 00000100:00100000:1.0:1788612554.857367:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:11481:x1875495893410560:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 385us (649us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1788612554.857373:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 163 00000100:00100000:0.0:1788612554.862431:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612554.862566:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893410688 00000100:00100000:1.0:1788612554.862576:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893410688 00000100:00100000:1.0:1788612554.862644:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 164 00000100:00100000:1.0:1788612554.862655:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:11481:x1875495893410688:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:1.0:1788612554.862729:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42275 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.862744:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42275 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.862771:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42275 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.862786:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af4227c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.862793:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af4227c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.862800:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af4227c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.862955:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.862965:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.862971:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612554.863011:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863034:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42275 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863041:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42275 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863046:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42275 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863061:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612554.863065:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42275 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863071:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42275 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863083:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:1.0:1788612554.863086:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612554.863090:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42275 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863096:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42275 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863108:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af4227c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863113:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af4227c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863130:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af4227c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863135:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612554.863137:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af4227c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863142:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af4227c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863159:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928e838ce500) 00010000:00010000:1.0:1788612554.863161:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612554.863164:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af4227c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863170:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af4227c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863184:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863190:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42283 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863195:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863200:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612554.863203:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863207:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863214:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:1.0:1788612554.863216:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612554.863218:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42283 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.863223:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612554.863300:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:11481:x1875495893410688:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 645us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612554.863307:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 164 00000100:00100000:2.0:1788612554.866890:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612554.866975:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893410944 00000100:00100000:3.0:1788612554.866986:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893410944 00000100:00100000:3.0:1788612554.867050:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:3.0:1788612554.867060:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:11481:x1875495893410944:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1788612554.867294:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+53:11481:x1875495893410944:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 235us (465us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788612554.867314:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:2.0:1788612554.933087:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612554.933258:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893411200 00000100:00100000:1.0:1788612554.933271:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893411200 00000100:00100000:1.0:1788612554.933342:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 165 00000100:00100000:1.0:1788612554.933352:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+53:11484:x1875495893411200:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1788612554.933376:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612554.933396:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4228a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb20 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.933611:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af42291 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.933639:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af42291 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.933652:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af42291 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.933670:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.933676:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.933684:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934225:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af4229f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934248:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af4229f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934257:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af4229f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612554.934269:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788612554.934375:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af42291 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934383:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af42291 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934389:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af42291 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934395:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612554.934399:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af42291 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934407:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af42291 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934419:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:2.0:1788612554.934422:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612554.934510:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af42291 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934518:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af42291 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934534:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934548:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42298 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934554:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934559:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612554.934562:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934568:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934576:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928e838ce500) 00010000:00010000:2.0:1788612554.934578:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612554.934581:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42298 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.934586:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60200/0xfc956d548af42298 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.935048:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4228a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb20 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.935068:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af4229f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb20 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612554.935077:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:2.0:1788612554.935080:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612554.935090:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd13600, rc 0) 00000100:00100000:2.0:1788612554.935171:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:11484:x1875495893411200:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1819us (2092us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788612554.935180:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 165 00000100:00100000:3.0:1788612554.937982:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612554.939559:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893411328 00000100:00100000:1.0:1788612554.939575:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893411328 00000100:00100000:1.0:1788612554.939661:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 166 00000100:00100000:1.0:1788612554.939673:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:11484:x1875495893411328:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:1.0:1788612554.939754:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.939776:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.939789:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.939818:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.939825:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.939833:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.939874:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612554.939879:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.939888:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.939900:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:1.0:1788612554.939920:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612554.939926:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612554.939933:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612554.940030:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:11484:x1875495893411328:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 348us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612554.941863:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 166 00000100:00100000:2.0:1788612554.942013:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612554.942879:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893411456 00000100:00100000:3.0:1788612554.942893:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893411456 00000100:00100000:3.0:1788612554.942954:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:3.0:1788612554.942964:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:2356:x1875495893411456:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612554.942981:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612554.943006:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af4229f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb20 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612554.944149:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:3.0:1788612554.944159:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612554.944236:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:2356:x1875495893411456:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 1270us (2220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612554.944245:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:3.0:1788612554.944387:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612554.944793:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893411712 00000100:00100000:1.0:1788612554.944801:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893411712 00000100:00100000:1.0:1788612554.944869:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:1.0:1788612554.944879:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:11484:x1875495893411712:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1788612554.945614:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:11484:x1875495893411712:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 733us (1223us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788612554.945637:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:2.0:1788612555.168743:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612555.170122:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893411968 00000100:00100000:0.0:1788612555.170138:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893411968 00000100:00100000:0.0:1788612555.170227:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 167 00000100:00100000:0.0:1788612555.170238:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:11502:x1875495893411968:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:0.0:1788612555.170265:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612555.170287:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af422b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb27 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.170399:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af422bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.170415:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af422bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.170441:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af422bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612555.170454:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788612555.170591:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af422b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb27 expref: 58 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.170611:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af422bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb27 expref: 57 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.170620:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:0.0:1788612555.170623:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788612555.170627:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf600, rc 0) 00000100:00100000:0.0:1788612555.170722:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:11502:x1875495893411968:12345-192.168.202.6@tcp:101:cat.0 Request processed in 484us (1989us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788612555.170731:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 167 00000100:00100000:0.0:1788612555.200151:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612555.200248:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893412096 00000100:00100000:3.0:1788612555.200257:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893412096 00000100:00100000:3.0:1788612555.200300:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 168 00000100:00100000:3.0:1788612555.200307:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:11503:x1875495893412096:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612555.200326:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612555.200343:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af422c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb2e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.200408:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af422d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.200437:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af422d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.200448:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af422d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612555.200479:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788612555.200482:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612555.200496:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af422d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.200515:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af422c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb2e expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.200529:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af422d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb2e expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.200535:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:3.0:1788612555.200537:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612555.200539:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030000, rc 0) 00000100:00100000:3.0:1788612555.200687:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+58:11503:x1875495893412096:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 379us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.200691:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 168 00000100:00100000:2.0:1788612555.210580:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612555.214739:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893412480 00000100:00100000:3.0:1788612555.214756:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893412480 00000100:00100000:3.0:1788612555.214832:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:3.0:1788612555.214889:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+58:11503:x1875495893412480:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1788612555.215249:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:11503:x1875495893412480:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 363us (4681us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788612555.215272:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:2.0:1788612555.218819:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612555.218960:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893412608 00000100:00100000:1.0:1788612555.218968:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893412608 00000100:00100000:1.0:1788612555.219030:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:1.0:1788612555.219041:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9238f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:11503:x1875495893412608:12345-192.168.202.6@tcp:103:lfs.0 00010000:00010000:1.0:1788612555.219059:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788612555.219092:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af42260 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb12 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.219115:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af422bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb27 expref: 58 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.219148:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4216b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddad3 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.219157:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e9231da00) 00010000:00010000:1.0:1788612555.219170:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612555.220302:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9238f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+56:11503:x1875495893412608:12345-192.168.202.6@tcp:103:lfs.0 Request processed in 1255us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612555.220314:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:0.0:1788612555.223043:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612555.223164:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893412736 00000100:00100000:1.0:1788612555.223173:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893412736 00000100:00100000:1.0:1788612555.223221:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 169 00000100:00100000:1.0:1788612555.223228:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+56:11503:x1875495893412736:12345-192.168.202.6@tcp:58:lfs.0 00010000:00010000:1.0:1788612555.223344:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.223358:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.223368:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612555.224160:0:8316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788612555.224238:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+56:11503:x1875495893412736:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 1008us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612555.224246:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 169 00000100:00100000:2.0:1788612555.248925:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612555.249062:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893412864 00000100:00100000:3.0:1788612555.249080:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893412864 00000100:00100000:3.0:1788612555.249146:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 170 00000100:00100000:3.0:1788612555.249157:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+56:11505:x1875495893412864:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612555.249180:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612555.249201:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af422de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb35 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249279:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af422e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249293:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af422e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249305:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af422e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249322:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af422ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249329:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af422ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249335:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af422ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249448:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af422f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249477:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af422f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249484:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af422f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612555.249527:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788612555.249533:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612555.249554:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af422f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249567:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af422f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249576:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af422e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249583:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af422e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249589:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af422e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249595:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612555.249599:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af422e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249608:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af422e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249733:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:3.0:1788612555.249737:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612555.249751:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af422e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249759:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af422e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249776:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af422ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249781:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af422ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249787:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af422ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249793:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612555.249796:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af422ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249802:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af422ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249810:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928ea7bbc800) 00010000:00010000:3.0:1788612555.249812:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612555.249815:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af422ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249821:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af422ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249957:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af422de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb35 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249984:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af422f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb35 expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.249991:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ce300) 00010000:00010000:3.0:1788612555.249993:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612555.249996:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077200, rc 0) 00000100:00100000:3.0:1788612555.250086:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:11505:x1875495893412864:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 929us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.250094:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 170 00000100:00100000:0.0:1788612555.308159:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914380800:0@lo:400:kworker.0 00000100:00100000:0.0:1788612555.308235:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612555.308468:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914380544:0@lo:400:kworker.0 00000100:00100000:2.0:1788612555.308506:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612555.308538:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612555.308544:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914380672:0@lo:400:kworker.0 00000100:00100000:2.0:1788612555.308567:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612555.308604:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914380544 00000100:00100000:2.0:1788612555.308611:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914380544 00000100:00100000:2.0:1788612555.308668:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788612555.308678:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914380544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612555.308729:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914380544:12345-0@lo:400:kworker.0 Request processed in 52us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612555.308736:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788612555.308805:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914380544:0@lo:400:kworker.0 00000100:00100000:2.0:1788612555.308881:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec03adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914380928:0@lo:400:kworker.0 00000100:00100000:2.0:1788612555.308912:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612555.308942:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914380800 00000100:00100000:2.0:1788612555.308946:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914380800 00000100:00100000:2.0:1788612555.308993:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914380672 00000100:00100000:2.0:1788612555.308997:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914380672 00000100:00100000:2.0:1788612555.309016:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788612555.309033:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914380800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612555.309116:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914380928 00000100:00100000:3.0:1788612555.309120:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914380928 00000100:00100000:3.0:1788612555.309149:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788612555.309157:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914380928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612555.309196:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914380928:12345-0@lo:400:kworker.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.309203:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1788612555.309220:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788612555.309224:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612555.309242:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec03adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914380928:0@lo:400:kworker.0 00000100:00100000:3.0:1788612555.309263:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788612555.309270:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914380672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612555.309305:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914380672:12345-0@lo:400:kworker.0 Request processed in 36us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.309311:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788612555.309344:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914380672:0@lo:400:kworker.0 00000100:00100000:1.0:1788612555.314190:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec03adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914381184:0@lo:400:kworker.0 00000100:00100000:1.0:1788612555.314265:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612555.314320:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612555.314326:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec03ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914381056:0@lo:400:kworker.0 00000100:00100000:1.0:1788612555.314355:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612555.314400:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914381184 00000100:00100000:1.0:1788612555.314407:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914381184 00000100:00100000:1.0:1788612555.314461:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788612555.314471:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914381184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612555.314520:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914381184:12345-0@lo:400:kworker.0 Request processed in 51us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612555.314527:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788612555.314571:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec03adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914381184:0@lo:400:kworker.0 00000100:00080000:1.0:1788612555.314596:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612555.314719:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914381056 00000100:00100000:3.0:1788612555.314723:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914381056 00000100:00100000:3.0:1788612555.314759:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788612555.314766:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914381056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612555.314804:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914381056:12345-0@lo:400:kworker.0 Request processed in 39us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.314810:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788612555.315129:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec03ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914381056:0@lo:400:kworker.0 00000100:00080000:1.0:1788612555.315145:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612555.315224:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914380800:12345-0@lo:400:kworker.0 Request processed in 6200us (6987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612555.315231:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788612555.317524:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914380800:0@lo:400:kworker.0 00000040:00080000:1.0:1788612555.372097:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788612555.372106:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612555.372167:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788612555.372173:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788612555.372285:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0346300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875495914381312:192.168.202.6@tcp:107:hsm_cdtr.0 00010000:00010000:2.0:1788612555.381785:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612555.383049:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91082480 going to sleep for 11 seconds 00000100:00100000:1.0:1788612555.383094:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0346300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875495914381312:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788612555.383317:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612555.383446:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893412992 00000100:00100000:3.0:1788612555.383453:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893412992 00000100:00100000:3.0:1788612555.383519:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 171 00000100:00100000:3.0:1788612555.383528:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:11516:x1875495893412992:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788612555.383559:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788612555.384850:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:11516:x1875495893412992:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 1303us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.384862:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 171 00000100:00100000:2.0:1788612555.390544:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612555.392813:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893413120 00000100:00100000:3.0:1788612555.393112:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893413120 00000100:00100000:3.0:1788612555.393240:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 172 00000100:00100000:3.0:1788612555.393253:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:11516:x1875495893413120:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788612555.393370:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af422fa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393400:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af422fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393413:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af422fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393473:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af42301 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393482:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af42301 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393489:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af42301 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393518:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393527:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393533:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612555.393570:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788612555.393574:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612555.393586:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393598:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af422fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393604:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af422fa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393611:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af422fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393652:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612555.393657:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af422fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393665:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af422fa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393678:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb600) 00010000:00010000:3.0:1788612555.393681:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612555.393686:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af422fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393691:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af422fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393703:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af42301 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393708:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af42301 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393713:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af42301 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393718:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0076000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612555.393721:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af42301 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393726:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af42301 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393741:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff928ea7bbc800) 00010000:00010000:3.0:1788612555.393743:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612555.393746:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af42301 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393752:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af42301 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393768:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393773:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42308 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393778:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393783:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612555.393785:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393790:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42308 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393796:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ce300) 00010000:00010000:3.0:1788612555.393799:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612555.393802:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42308 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.393806:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612555.393945:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:11516:x1875495893413120:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 694us (3421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.393954:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 172 00000100:00100000:2.0:1788612555.397250:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612555.397319:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893413376 00000100:00100000:3.0:1788612555.397329:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893413376 00000100:00100000:3.0:1788612555.397396:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 173 00000100:00100000:3.0:1788612555.397406:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:11516:x1875495893413376:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612555.397428:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612555.397451:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af4230f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb3c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.397551:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42316 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.397565:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.397577:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612555.397587:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788612555.397696:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.397704:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42316 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.397710:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42316 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.397727:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612555.397732:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42316 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.397741:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42316 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.397754:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ce300) 00010000:00010000:3.0:1788612555.397756:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612555.397761:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42316 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.397768:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42316 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.397809:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af4230f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb3c expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.397819:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb600) 00010000:00010000:3.0:1788612555.397821:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788612555.397825:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af4230f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb3c expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.397903:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030600, rc 0) 00000100:00100000:3.0:1788612555.397969:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+58:11516:x1875495893413376:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 564us (731us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788612555.397977:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 173 00000100:00100000:2.0:1788612555.406589:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612555.406702:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893413504 00000100:00100000:3.0:1788612555.406720:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893413504 00000100:00100000:3.0:1788612555.406786:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 174 00000100:00100000:3.0:1788612555.406798:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+58:11516:x1875495893413504:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788612555.407042:0:8316:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788612555.407148:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+58:11516:x1875495893413504:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 351us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.407156:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 174 00000100:00100000:0.0:1788612555.412445:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612555.414819:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893413760 00000100:00100000:3.0:1788612555.414834:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893413760 00000100:00100000:1.0:1788612555.415298:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 175 00000100:00100000:1.0:1788612555.415310:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+58:11516:x1875495893413760:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612555.415333:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612555.415336:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788612555.415364:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af422d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb2e expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.415390:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:1.0:1788612555.415397:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612555.415413:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af42324 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb43 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788612555.415870:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788612555.416096:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4232b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.416111:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4232b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.416122:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4232b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.416179:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af42324 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb43 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.416195:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4232b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb43 expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.416203:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff928e838ce100) 00010000:00010000:1.0:1788612555.416207:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612555.416210:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60400, rc 0) 00000100:00100000:1.0:1788612555.416289:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:11516:x1875495893413760:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 980us (3855us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788612555.416297:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 175 00000100:00100000:1.0:1788612555.421421:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612555.422702:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893414016 00000100:00100000:0.0:1788612555.422714:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893414016 00000100:00100000:0.0:1788612555.422778:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 176 00000100:00100000:0.0:1788612555.422788:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:11516:x1875495893414016:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788612555.422873:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612555.422908:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4232b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb43 expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.422926:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff928e838ce100) 00010000:00010000:0.0:1788612555.422939:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612555.422962:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42339 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.422976:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.422986:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423000:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42340 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x273fde65 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423007:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x273fde65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423014:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x273fde65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423088:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423100:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42339 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423106:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42339 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423113:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612555.423117:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42339 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423124:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42339 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423133:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:0.0:1788612555.423135:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612555.423139:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42339 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423145:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42339 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423155:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x273fde65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423160:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42340 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x273fde65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423166:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x273fde65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423171:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612555.423178:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x273fde65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423184:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42340 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x273fde65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423192:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x273fde65 (ffff928e91fbbf00) 00010000:00010000:0.0:1788612555.423194:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612555.423198:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42340 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x273fde65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.423203:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42340 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x273fde65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612555.423284:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+58:11516:x1875495893414016:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 497us (1872us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788612555.423292:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 176 00000100:00100000:0.0:1788612555.427584:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612555.428548:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893414144 00000100:00100000:2.0:1788612555.428561:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893414144 00000100:00100000:2.0:1788612555.428638:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 177 00000100:00100000:2.0:1788612555.428651:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+58:11516:x1875495893414144:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612555.428674:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612555.428699:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af42347 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb4a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.428740:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af4234e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.428756:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af4234e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.428768:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af4234e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.428888:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af42347 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb4a expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.428916:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af4234e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb4a expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.428924:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff928e9231de00) 00010000:00010000:2.0:1788612555.428928:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788612555.428932:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd12200, rc 0) 00000100:00100000:2.0:1788612555.429014:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:11516:x1875495893414144:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 366us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612555.429122:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 177 00000100:00100000:0.0:1788612555.436942:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612555.436983:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893414400 00000100:00100000:0.0:1788612555.436994:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893414400 00000100:00100000:1.0:1788612555.437154:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 178 00000100:00100000:1.0:1788612555.437165:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:11516:x1875495893414400:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788612555.437252:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42355 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.437273:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.437286:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612555.437584:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788612555.437594:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349280755184ns, next at 350280753379ns, rc = 0 00000004:00010000:1.0:1788612555.437774:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e92f55a reply state 00000000e7a75157 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612555.437784:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612555.438142:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:11516:x1875495893414400:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 976us (1205us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788612555.438150:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 178 00010000:00010000:3.0:1788612555.440091:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.440105:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42355 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.440112:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42355 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.440117:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612555.440122:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42355 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.440128:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42355 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.440144:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff928e9231de00) 00010000:00010000:3.0:1788612555.440146:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788612555.440151:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42355 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.440158:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42355 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612555.444976:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612555.448560:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893414528 00000100:00100000:3.0:1788612555.448574:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893414528 00000100:00100000:3.0:1788612555.448649:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 179 00000100:00100000:3.0:1788612555.448660:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+60:11516:x1875495893414528:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612555.448684:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612555.448704:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af4235c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb51 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.448765:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af4235c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb51 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.448782:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af4235c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb51 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.448804:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff928e9231de00) 00010000:00010000:3.0:1788612555.448808:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612555.448812:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030600, rc 0) 00000100:00100000:3.0:1788612555.448895:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:11516:x1875495893414528:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 236us (3932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.448902:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 179 00000100:00100000:0.0:1788612555.457051:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612555.458935:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893414656 00000100:00100000:1.0:1788612555.458950:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893414656 00000100:00100000:1.0:1788612555.459091:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:1.0:1788612555.459102:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893414656:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788612555.459436:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2355:x1875495893414656:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 335us (2397us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788612555.459460:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:3.0:1788612555.461956:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612555.462237:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893414912 00000100:00100000:1.0:1788612555.462248:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893414912 00000100:00100000:1.0:1788612555.462309:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:1.0:1788612555.462320:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:11516:x1875495893414912:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788612555.462596:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+62:11516:x1875495893414912:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 277us (651us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788612555.462604:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00080000:0.0:1788612555.463684:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612555.465662:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612555.465908:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893415168 00000100:00100000:0.0:1788612555.465918:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893415168 00000100:00100000:0.0:1788612555.466015:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 180 00000100:00100000:0.0:1788612555.466035:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+62:11516:x1875495893415168:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788612555.466142:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+62:11516:x1875495893415168:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 118us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612555.466150:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 180 00000100:00100000:0.0:1788612555.469424:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612555.469479:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893415296 00000100:00100000:3.0:1788612555.469487:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893415296 00000100:00100000:3.0:1788612555.469533:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 181 00000100:00100000:3.0:1788612555.469540:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+62:11516:x1875495893415296:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612555.469555:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612555.469584:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42363 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb58 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.469649:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af4236a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.469667:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af4236a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.469679:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af4236a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612555.469712:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612555.469730:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af4236a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.469748:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42363 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb58 expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.469760:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af4236a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb58 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.469766:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff928e9231de00) 00010000:00010000:3.0:1788612555.469768:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788612555.469771:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030400, rc 0) 00000100:00100000:3.0:1788612555.469810:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+63:11516:x1875495893415296:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 272us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.469814:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 181 00000100:00100000:3.0:1788612555.472486:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612555.472557:0:12375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893415424 00000100:00100000:1.0:1788612555.472564:0:12375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893415424 00000100:00100000:1.0:1788612555.472615:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1788612555.472625:0:12375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2356:x1875495893415424:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612555.472644:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612555.472668:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af42371 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb5f expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788612555.472695:0:12375:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c0fcb, blocks: 0x1 00010000:00010000:1.0:1788612555.472713:0:12375:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1788612555.472717:0:12375:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612555.472724:0:12375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af42371 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb5f expref: 8 pid: 12375 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.472737:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af42371 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb5f expref: 8 pid: 12375 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.472762:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60000, rc 0) 00000100:00100000:1.0:1788612555.472809:0:12375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2356:x1875495893415424:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 186us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612555.472814:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1788612555.475695:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612555.475793:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893415680 00000100:00100000:0.0:1788612555.475803:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893415680 00000100:00100000:0.0:1788612555.475895:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 182 00000100:00100000:0.0:1788612555.475905:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebf81ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+63:11516:x1875495893415680:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788612555.476013:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebf81ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+63:11516:x1875495893415680:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 109us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612555.476031:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 182 00000100:00100000:0.0:1788612555.479401:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612555.479560:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893415808 00000100:00100000:1.0:1788612555.479571:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893415808 00000100:00100000:1.0:1788612555.479672:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:1.0:1788612555.479682:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:11516:x1875495893415808:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612555.479699:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612555.479718:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b15c451c/0xfc956d548af42378 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb66 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.479754:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af42371 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb5f expref: 9 pid: 12375 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.479763:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612555.479767:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612555.479772:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b15c451c/0xfc956d548af42378 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb66 expref: 9 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.479808:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af42371 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb5f expref: 9 pid: 12375 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.479821:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af42371 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb5f expref: 9 pid: 12375 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612555.479874:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0749880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1875495914381440:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612555.479963:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c25780 going to sleep for 11 seconds 00000100:00100000:1.0:1788612555.484682:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612555.484893:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0749880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8463:1875495914381440:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612555.484930:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b15c451c/0xfc956d548af42378 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb66 expref: 9 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.484955:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61c00, rc 0) 00000100:00100000:2.0:1788612555.485036:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:11516:x1875495893415808:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 5344us (5638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612555.485046:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:3.0:1788612555.486068:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893415936 00000100:00100000:3.0:1788612555.486092:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893415936 00010000:00010000:3.0:1788612555.486131:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af42371 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb5f expref: 9 pid: 12375 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612555.486442:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:3.0:1788612555.486453:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2355:x1875495893415936:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612555.486469:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612555.486493:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af42371 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb5f expref: 9 pid: 12375 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.486507:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af42371 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb5f expref: 9 pid: 12375 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.486528:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090eeffe0/0xfc956d548af42371 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb5f expref: 9 pid: 12375 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.486544:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612555.486549:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612555.486557:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b15c451c/0xfc956d548af42378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb66 expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.486568:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b15c451c/0xfc956d548af42378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb66 expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.486611:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b15c451c/0xfc956d548af42378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb66 expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612555.486707:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec07dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5839:1875495914381568:192.168.202.6@tcp:105: 00000100:00100000:3.0:1788612555.486796:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a26480 going to sleep for 11 seconds 00000100:00100000:3.0:1788612555.499817:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec07dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5839:1875495914381568:192.168.202.6@tcp:105: 00010000:00010000:3.0:1788612555.499895:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612555.499971:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2355:x1875495893415936:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 13519us (15302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.499983:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:1.0:1788612555.502093:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612555.502180:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893416064 00000100:00100000:0.0:1788612555.502191:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893416064 00002000:00100000:0.0:1788612555.502249:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff928ec0749880 x1875495893416064/t0(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:201/0 lens 504/0 e 0 to 0 dl 1788612566 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788612555.502263:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928ec0749880 with x1875495893416064 ext(0->8) 00002000:00010000:0.0:1788612555.502269:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928ec0749880 00000100:00100000:0.0:1788612555.502303:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:0.0:1788612555.502314:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2355:x1875495893416064:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788612555.503140:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+10:2355:x1875495893416064:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 Request processed in 824us (1057us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788612555.503150:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00002000:00100000:0.0:1788612555.503158:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff928ec0749880 x1875495893416064/t4294967314(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:201/0 lens 504/448 e 0 to 0 dl 1788612566 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788612555.503167:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928ec0749880 with x1875495893416064 ext(0->8) 00002000:00010000:0.0:1788612555.503171:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928ec0749880 00000100:00100000:0.0:1788612555.515658:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612555.517070:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893416192 00000100:00100000:2.0:1788612555.517086:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893416192 00000100:00100000:2.0:1788612555.517177:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 183 00000100:00100000:2.0:1788612555.517190:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+63:11516:x1875495893416192:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788612555.585622:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000001:00080000:0.0:1788612555.585701:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1788612555.585708:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:0.0:1788612555.585788:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:0.0:1788612555.585803:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788612555.585811:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff928ea7a26e40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788612555.585816:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928ec00c4500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff928eb5b72840 00000020:00080000:0.0:1788612555.585819:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928ec00c4800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff928e99358800 00000020:00080000:0.0:1788612555.586087:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788612555.586253:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788612555.586274:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914381696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788612555.586338:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612555.586573:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612555.586580:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914381824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788612555.586605:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612555.586642:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914381696 00000100:00100000:0.0:1788612555.586649:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914381696 00000100:00100000:0.0:1788612555.586683:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914381824 00000100:00100000:0.0:1788612555.586686:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914381824 00000100:00100000:0.0:1788612555.586703:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788612555.586711:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914381696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788612555.586733:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1788612555.586762:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c0fc9, atime: 0x6a9c0fc9, ctime: 0x6a9c0fc9, blocks: 0xb 00010000:00010000:0.0:1788612555.586770:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af4237f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.586787:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788612555.586803:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612555.586811:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af4237f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.586999:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af4237f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.587012:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af4237f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.587020:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af4237f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.587047:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788612555.587981:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788612555.587993:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914381824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788612555.588106:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788612555.588110:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788612555 00002000:00010000:1.0:1788612555.588112:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788612555.588114:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788612555 -> 1788612555 00002000:00010000:1.0:1788612555.588117:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788612555.588296:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:11516:x1875495893416192:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 71106us (72646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.588306:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 183 00000100:00100000:0.0:1788612555.589231:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875495914381696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2517us (2889us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788612555.589240:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:0.0:1788612555.589265:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612555.589273:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af4237f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.589284:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612555.589289:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af4237f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.589300:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af4237f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.589333:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af4237f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.589342:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c18b0181/0xfc956d548af4237f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.589360:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612555.589362:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612555.589363:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788612555.589490:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff928ebfc34700/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788612555.589497:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914381696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788612555.592495:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875495914381824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4495us (5878us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788612555.592511:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1788612555.592701:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff928ea7ba5f80/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788612555.592718:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914381824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788612555.593754:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612555.597621:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893416320 00000100:00100000:2.0:1788612555.597646:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893416320 00000100:00100000:2.0:1788612555.597715:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:2.0:1788612555.597727:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+10:2356:x1875495893416320:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788612555.705832:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612555.705899:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612555.705937:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612555.706222:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893416704 00000100:00100000:0.0:1788612555.706233:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893416704 00000100:00100000:0.0:1788612555.706524:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 154 00000100:00100000:0.0:1788612555.706534:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+5:2356:x1875495893416704:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612555.706615:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+5:2356:x1875495893416704:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 82us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612555.706632:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 154 00000100:00100000:0.0:1788612555.706657:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893416576 00000100:00100000:0.0:1788612555.706661:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893416576 00000100:00100000:0.0:1788612555.706691:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:0.0:1788612555.706698:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2356:x1875495893416576:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612555.706724:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2356:x1875495893416576:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612555.706730:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00080000:0.0:1788612555.706751:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788612555.706766:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612555.707504:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+10:2356:x1875495893416320:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 109777us (113752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612555.707513:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:3.0:1788612555.707661:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893416448 00000100:00100000:3.0:1788612555.707667:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893416448 00000100:00100000:3.0:1788612555.707708:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 295 00000100:00100000:3.0:1788612555.707717:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2356:x1875495893416448:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612555.707746:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2356:x1875495893416448:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 31us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.707752:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 295 00000001:00080000:1.0:1788612555.713191:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:1.0:1788612555.713224:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1788612555.720344:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612555.720456:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893416960 00000100:00100000:3.0:1788612555.720466:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893416960 00000100:00100000:3.0:1788612555.720523:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 184 00000100:00100000:3.0:1788612555.720534:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:11516:x1875495893416960:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788612555.720587:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612555.720616:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af4236a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb58 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.720653:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff928e9231de00) 00010000:00010000:3.0:1788612555.720659:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612555.720692:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42386 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.720708:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.720717:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612555.721197:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aea9993b reply state 00000000cd33d574 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612555.721207:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788612555.721314:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:11516:x1875495893416960:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 781us (978us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788612555.721321:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 184 00010000:00010000:0.0:1788612555.723185:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.723200:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42386 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.723207:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.723213:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612555.723218:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.723226:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42386 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.723241:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff928e9231de00) 00010000:00010000:0.0:1788612555.723244:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612555.723249:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42386 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.723256:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42386 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612555.724327:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612555.724396:0:12375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893417088 00000100:00100000:3.0:1788612555.724405:0:12375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893417088 00000100:00100000:3.0:1788612555.724458:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:3.0:1788612555.724468:0:12375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2355:x1875495893417088:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788612555.724714:0:12375:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788612555.724717:0:12375:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788612555 -> 1788612555 00002000:00010000:3.0:1788612555.724720:0:12375:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788612553 00002000:00010000:3.0:1788612555.724722:0:12375:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788612555 -> 1788612555 00002000:00010000:3.0:1788612555.724724:0:12375:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788612555.724789:0:12375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2355:x1875495893417088:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 322us (468us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788612555.724796:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:2.0:1788612555.730206:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612555.730278:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893417344 00000100:00100000:0.0:1788612555.730291:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893417344 00000100:00100000:0.0:1788612555.730355:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 185 00000100:00100000:0.0:1788612555.730365:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:11516:x1875495893417344:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788612555.730438:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.730460:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af4234e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb4a expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.730470:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.730504:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af4234e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb4a expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.730518:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af4234e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb4a expref: 18 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612555.730531:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914381952:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612555.730611:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacc40a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612555.736881:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612555.736947:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914381952:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612555.736972:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612555.741864:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893417472 00000100:00100000:3.0:1788612555.741879:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893417472 00010000:00010000:3.0:1788612555.743786:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af4234e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb4a expref: 19 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612555.743869:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:3.0:1788612555.743884:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:2356:x1875495893417472:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612555.743902:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612555.743910:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af4234e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb4a expref: 19 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.744447:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af4234e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb4a expref: 19 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.744473:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af4234e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb4a expref: 19 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.744487:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff928e9231de00) 00010000:00010000:3.0:1788612555.744492:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.744503:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.744511:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.744556:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612555.744617:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:2356:x1875495893417472:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 738us (7744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.744638:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00010000:00010000:1.0:1788612555.745003:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.745012:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.745052:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.745059:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.745074:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.745079:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612555.745084:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.745092:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.745101:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff928e9231de00) 00010000:00010000:1.0:1788612555.745104:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788612555.745108:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.745114:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af4238d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612555.745183:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:11516:x1875495893417344:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 Request processed in 14818us (14987us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788612555.745191:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 185 00000100:00100000:3.0:1788612555.747998:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612555.748102:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893417600 00000100:00100000:1.0:1788612555.748112:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893417600 00000100:00100000:1.0:1788612555.748166:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:1.0:1788612555.748177:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2355:x1875495893417600:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788612555.748735:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008a5ae285/0xfc956d548af42394 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.748755:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b15c451c/0xfc956d548af42378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb66 expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.748771:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612555.748775:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612555.748780:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a5ae285/0xfc956d548af42394 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.748820:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b15c451c/0xfc956d548af42378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb66 expref: 8 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.749459:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b15c451c/0xfc956d548af42378 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb66 expref: 8 pid: 8463 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612555.749481:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c55180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875495914382080:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612555.749572:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc540 going to sleep for 11 seconds 00000100:00100000:1.0:1788612555.756610:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c55180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875495914382080:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612555.756656:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a5ae285/0xfc956d548af42394 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612555.757129:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612555.757221:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893417728 00000100:00100000:0.0:1788612555.757229:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893417728 00010000:00010000:0.0:1788612555.757266:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b15c451c/0xfc956d548af42378 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb66 expref: 9 pid: 8463 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612555.757310:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:0.0:1788612555.757320:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2355:x1875495893417728:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612555.757348:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612555.757379:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b15c451c/0xfc956d548af42378 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb66 expref: 9 pid: 8463 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.757393:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b15c451c/0xfc956d548af42378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb66 expref: 9 pid: 8463 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.757417:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b15c451c/0xfc956d548af42378 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb66 expref: 9 pid: 8463 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.757433:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612555.757438:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612555.757444:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a5ae285/0xfc956d548af42394 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.757454:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a5ae285/0xfc956d548af42394 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.757489:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612555.757545:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2355:x1875495893417728:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 226us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612555.757552:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00010000:00010000:2.0:1788612555.758377:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a5ae285/0xfc956d548af42394 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.758390:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a5ae285/0xfc956d548af42394 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.758417:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008a5ae285/0xfc956d548af42394 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.758426:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a5ae285/0xfc956d548af42394 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.758436:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a5ae285/0xfc956d548af42394 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.758457:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612555.758462:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a5ae285/0xfc956d548af42394 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.758472:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a5ae285/0xfc956d548af42394 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.758488:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a5ae285/0xfc956d548af42394 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.758496:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a5ae285/0xfc956d548af42394 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612555.758572:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2355:x1875495893417600:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 10396us (10954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612555.758581:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:1.0:1788612555.765563:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612555.765699:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893417984 00000100:00100000:0.0:1788612555.765710:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893417984 00000100:00100000:0.0:1788612555.765771:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 186 00000100:00100000:0.0:1788612555.765781:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+17:11516:x1875495893417984:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788612555.765892:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af4239b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.765910:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af4239b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.765922:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af4239b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.766216:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.766227:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af4235c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb51 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.766235:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.766271:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af4235c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb51 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.766286:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af4235c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb51 expref: 18 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612555.766302:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914382208:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612555.771214:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacc40f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612555.773528:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914382208:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612555.773562:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612555.774812:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612555.775091:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893418112 00000100:00100000:0.0:1788612555.775101:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893418112 00010000:00010000:0.0:1788612555.775138:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af4235c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb51 expref: 19 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612555.775177:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:0.0:1788612555.775186:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:2355:x1875495893418112:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612555.775202:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612555.775208:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af4235c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb51 expref: 19 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.775220:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af4235c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb51 expref: 19 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.775241:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af4235c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb51 expref: 19 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.775257:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff928e9231de00) 00010000:00010000:0.0:1788612555.775262:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.775271:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.775279:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.775310:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612555.775377:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:2355:x1875495893418112:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 184us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612555.775385:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00010000:00010000:3.0:1788612555.775511:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.775519:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612555.775697:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1788612555.775870:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788612555.775915:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1788612555.775993:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c50000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1875495914382336:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788612555.776047:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612555.776077:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c25cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612555.776485:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914382336 00000100:00100000:0.0:1788612555.776491:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914382336 00000100:00100000:0.0:1788612555.776530:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612555.776538:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875495914382336:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788612555.776610:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875495914382336:12345-0@lo:1000:mdt00_000.0 Request processed in 73us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612555.776617:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788612555.777119:0:5852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788612555.777126:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff928ea7ba5f80, transno 4294967315 00000100:00100000:3.0:1788612555.777145:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c50000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1875495914382336:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788612555.777620:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788612555.777809:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0822680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1875495914382464:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788612555.777885:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612555.777912:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a26780 going to sleep for 11 seconds 00000100:00100000:0.0:1788612555.778085:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914382464 00000100:00100000:0.0:1788612555.778091:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914382464 00000100:00100000:0.0:1788612555.778137:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612555.778145:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875495914382464:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788612555.778310:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1875495914382464:12345-0@lo:1000:mdt00_000.0 Request processed in 165us (424us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788612555.778317:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788612555.778742:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0822680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1875495914382464:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788612555.778776:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.778793:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.778800:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.778805:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdfc00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612555.778809:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.778817:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.779033:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff928e9231de00) 00010000:00010000:3.0:1788612555.779037:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612555.779043:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.779050:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af423a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.779082:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.779089:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.779095:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.779100:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612555.779109:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.779115:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422d7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.779122:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ce300) 00010000:00010000:3.0:1788612555.779125:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612555.779128:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612555.779134:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af422d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.779202:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.779217:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af422f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb35 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.779227:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.779254:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af422f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb35 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.779274:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af422f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb35 expref: 21 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612555.779287:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7ba5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914382592:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612555.779358:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612555.783361:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612555.783477:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7ba5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914382592:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612555.783507:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612555.783567:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893418240 00000100:00100000:1.0:1788612555.783575:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893418240 00010000:00010000:1.0:1788612555.783612:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af422f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb35 expref: 22 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612555.783661:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:1.0:1788612555.783671:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+22:2356:x1875495893418240:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612555.783701:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612555.783708:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af422f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb35 expref: 22 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.783720:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af422f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb35 expref: 22 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.783742:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af422f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb35 expref: 22 pid: 5852 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.783759:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ce300) 00010000:00010000:1.0:1788612555.783764:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.783774:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.783783:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612555.783810:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612555.783897:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:2356:x1875495893418240:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 226us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612555.783906:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 74 00010000:00010000:2.0:1788612555.784178:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784187:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784199:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784205:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784212:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784217:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612555.784222:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784230:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784248:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ce300) 00010000:00010000:2.0:1788612555.784251:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612555.784255:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784261:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af423a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784274:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af4239b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784279:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af4239b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784285:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af4239b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784290:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdec00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612555.784292:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af4239b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784298:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af4239b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784304:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ce300) 00010000:00010000:2.0:1788612555.784306:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788612555.784309:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af4239b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612555.784314:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af4239b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612555.784509:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:11516:x1875495893417984:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 18729us (18955us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788612555.784517:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 186 00000020:00080000:2.0:1788612555.784521:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788612555.785479:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788612555.785484:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612555.786074:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1788612555.786084:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788612555.790222:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612555.793455:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893418496 00000100:00100000:0.0:1788612555.793471:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893418496 00000100:00100000:0.0:1788612555.793543:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:0.0:1788612555.793555:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e8347cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:11516:x1875495893418496:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788612555.794208:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788612555.794309:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788612555.794351:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af423b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.794367:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af423b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.794390:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af423b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.794400:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af423b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.794406:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af423b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.794412:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af423b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.794434:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788612555.794531:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e8347cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+22:11516:x1875495893418496:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 977us (4315us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788612555.794540:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 50 00000020:00080000:0.0:1788612555.794545:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788612555.794604:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612555.794611:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af423b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.794618:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612555.794622:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af423b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.794631:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af423b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.794644:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff928e91fbbf00) 00010000:00010000:0.0:1788612555.794647:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788612555.794658:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af423b0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.794664:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af423b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612555.794679:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612555.794681:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612555.794682:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612555.824604:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612555.824691:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914382720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612555.824783:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612555.824831:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914382720 00000100:00100000:3.0:1788612555.824858:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914382720 00000100:00100000:3.0:1788612555.824910:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788612555.824919:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875495914382720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612555.824940:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788612555.824983:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875495914382720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612555.824990:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788612555.825049:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914382720:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788612556.041153:0:12517:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788612556.041165:0:12517:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612556.041204:0:12517:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788612556.041210:0:12517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788612556.234055:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612556.234325:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893418752 00000100:00100000:3.0:1788612556.234343:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893418752 00000100:00100000:3.0:1788612556.234514:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 187 00000100:00100000:3.0:1788612556.234527:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+22:11526:x1875495893418752:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612556.234554:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612556.234578:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af423b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb6d expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.234799:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af423be lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.234816:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af423be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.235928:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af423be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612556.235952:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788612556.236107:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af423b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb6d expref: 25 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.236125:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af423be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb6d expref: 24 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.236134:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:3.0:1788612556.236136:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788612556.236140:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030400, rc 0) 00000100:00100000:3.0:1788612556.237477:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+24:11526:x1875495893418752:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 2945us (3425us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788612556.237488:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 187 00000100:00080000:0.0:1788612556.238423:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612556.244822:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612556.247522:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893418880 00000100:00100000:0.0:1788612556.247537:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893418880 00000100:00100000:0.0:1788612556.247711:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 188 00000100:00100000:0.0:1788612556.247722:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+24:11526:x1875495893418880:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:0.0:1788612556.247799:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af423cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.247816:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af423cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.247827:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af423cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.247859:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af423d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.247867:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af423d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.247874:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af423d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248103:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af423da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248118:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af423da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248124:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af423da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788612556.248164:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af423da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248176:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af423cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248182:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af423cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248188:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af423cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248194:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612556.248198:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af423cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248205:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af423cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248217:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:0.0:1788612556.248220:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612556.248225:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af423cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248230:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af423cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248248:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af423d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248253:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af423d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248259:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af423d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248263:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdea00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612556.248266:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af423d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248271:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af423d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248278:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928e91fbbf00) 00010000:00010000:0.0:1788612556.248280:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612556.248283:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af423d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248288:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdea00/0xfc956d548af423d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248301:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af423da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248307:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af423da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248313:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af423da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248323:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdfa00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612556.248326:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af423da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248331:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af423da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248338:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e91fbb900) 00010000:00010000:0.0:1788612556.248340:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612556.248343:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af423da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.248347:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfa00/0xfc956d548af423da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612556.248587:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+24:11526:x1875495893418880:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 865us (3772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612556.248596:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 188 00000100:00100000:3.0:1788612556.312445:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612556.313097:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893419136 00000100:00100000:1.0:1788612556.313108:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893419136 00000100:00100000:1.0:1788612556.313170:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 189 00000100:00100000:1.0:1788612556.313180:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+24:11529:x1875495893419136:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1788612556.313199:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612556.313219:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af423e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb74 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.313289:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af423e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.313304:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af423e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.313316:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af423e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.313331:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af423ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.313337:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af423ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.313344:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af423ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.313716:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af423f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.313725:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af423f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.313744:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af423f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612556.313754:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788612556.313983:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af423e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.313991:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af423e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.313997:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af423e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.314002:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612556.314007:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af423e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.314013:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af423e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.314024:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:1.0:1788612556.314027:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612556.314041:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af423e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.314047:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af423e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.314059:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af423ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.314064:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af423ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.314076:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af423ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.314082:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612556.314084:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af423ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.314091:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af423ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.314099:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928e838cea00) 00010000:00010000:1.0:1788612556.314101:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612556.314104:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af423ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.314110:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af423ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.314149:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af423e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb74 expref: 27 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.314162:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af423f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb74 expref: 26 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.314168:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ceb00) 00010000:00010000:1.0:1788612556.314170:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612556.314173:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60e00, rc 0) 00000100:00100000:1.0:1788612556.314281:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+26:11529:x1875495893419136:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1102us (1846us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788612556.314298:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 189 00000100:00100000:3.0:1788612556.324269:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612556.324312:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893419264 00000100:00100000:3.0:1788612556.324321:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893419264 00000100:00100000:3.0:1788612556.324372:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 190 00000100:00100000:3.0:1788612556.324382:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+26:11529:x1875495893419264:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:3.0:1788612556.324448:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42404 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.324464:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.324477:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.324504:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.324510:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42404 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.324516:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.324522:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612556.324526:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.324533:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42404 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.324556:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ceb00) 00010000:00010000:3.0:1788612556.324559:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788612556.324565:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42404 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.324571:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42404 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612556.324643:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+26:11529:x1875495893419264:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 261us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612556.324650:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 190 00000100:00100000:3.0:1788612556.336120:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612556.336155:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893419520 00000100:00100000:3.0:1788612556.336163:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893419520 00000100:00100000:3.0:1788612556.336213:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:3.0:1788612556.336223:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+26:11529:x1875495893419520:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1788612556.336444:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+27:11529:x1875495893419520:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 221us (334us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788612556.336453:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:3.0:1788612556.395124:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612556.395194:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893419776 00000100:00100000:2.0:1788612556.395205:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893419776 00000100:00100000:2.0:1788612556.395267:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 191 00000100:00100000:2.0:1788612556.395278:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+27:11063:x1875495893419776:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1788612556.395301:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612556.395322:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13000/0xfc956d548af4240b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb7b expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.395419:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.395434:0:8316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af423f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb74 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.395443:0:8316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.395539:0:8316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af423f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb74 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.395568:0:8316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af423f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb74 expref: 28 pid: 5854 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612556.395581:0:8316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7ba5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8316:1875495914382848:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612556.395735:0:8316:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b723c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612556.398498:0:8316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7ba5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8316:1875495914382848:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612556.398531:0:8316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612556.398892:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612556.399156:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893419904 00000100:00100000:1.0:1788612556.399167:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893419904 00010000:00010000:1.0:1788612556.399215:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af423f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb74 expref: 29 pid: 5854 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612556.399251:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 75 00010000:00010000:0.0:1788612556.399308:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612556.399348:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+29:2355:x1875495893419904:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612556.399364:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612556.399371:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af423f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb74 expref: 29 pid: 5854 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.399391:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af423f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb74 expref: 29 pid: 5854 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.399492:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af423f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb74 expref: 29 pid: 5854 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.399508:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ceb00) 00010000:00010000:1.0:1788612556.399513:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.399520:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.399527:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.399578:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612556.399643:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+28:2355:x1875495893419904:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 303us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612556.399652:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 75 00010000:00010000:2.0:1788612556.399880:0:8316:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.399889:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612556.399907:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788612556.400064:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13000/0xfc956d548af4240b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb7b expref: 29 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.400080:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb7b expref: 28 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.400087:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ceb00) 00010000:00010000:2.0:1788612556.400089:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788612556.400091:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd13400, rc 0) 00000100:00100000:2.0:1788612556.400126:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+28:11063:x1875495893419776:12345-192.168.202.6@tcp:101:bash.0 Request processed in 4850us (5014us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788612556.400144:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 191 00000100:00100000:2.0:1788612556.403039:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612556.403132:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893420160 00000100:00100000:3.0:1788612556.403145:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893420160 00000100:00100000:3.0:1788612556.403201:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 192 00000100:00100000:3.0:1788612556.403209:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+28:11063:x1875495893420160:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:3.0:1788612556.403464:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42420 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.403495:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.403506:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612556.403556:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788612556.403581:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec521f54 reply state 0000000005766861 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612556.403589:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788612556.403631:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788612556.403745:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+32:11063:x1875495893420160:12345-192.168.202.6@tcp:36:bash.0 Request processed in 535us (727us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788612556.403751:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 192 00000020:00080000:3.0:1788612556.403756:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788612556.405411:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.405427:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42420 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.405434:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42420 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.405439:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612556.405444:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42420 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.405451:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42420 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.405467:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ceb00) 00010000:00010000:1.0:1788612556.405470:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612556.405475:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42420 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.405482:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42420 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612556.406696:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612556.406754:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893420288 00000100:00100000:1.0:1788612556.406764:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893420288 00000100:00100000:1.0:1788612556.406869:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 193 00000100:00100000:1.0:1788612556.406880:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+31:11063:x1875495893420288:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1788612556.406903:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612556.406920:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42427 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb82 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.406977:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42427 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb82 expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.406991:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42427 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb82 expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.407021:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ceb00) 00010000:00010000:1.0:1788612556.407025:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612556.407028:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60c00, rc 0) 00000100:00100000:1.0:1788612556.407099:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+32:11063:x1875495893420288:12345-192.168.202.6@tcp:101:bash.0 Request processed in 221us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612556.407105:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 193 00000100:00100000:3.0:1788612556.412263:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612556.413181:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893420416 00000100:00100000:2.0:1788612556.413193:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893420416 00000100:00100000:2.0:1788612556.413267:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:2.0:1788612556.413278:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:11063:x1875495893420416:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1788612556.413296:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612556.413317:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fdd5b0c/0xfc956d548af4242e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb89 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612556.413348:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c0fcb, atime: 0x6a9c0fc9, ctime: 0x6a9c0fcb, blocks: 0xb 00010000:00010000:2.0:1788612556.413370:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:2.0:1788612556.413375:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612556.413391:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fdd5b0c/0xfc956d548af4242e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb89 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.413599:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002fdd5b0c/0xfc956d548af4242e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb89 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.413615:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd13000, rc 0) 00000100:00100000:2.0:1788612556.413685:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:11063:x1875495893420416:12345-192.168.202.6@tcp:101:bash.0 Request processed in 408us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612556.413694:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:3.0:1788612556.417291:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612556.417674:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893420544 00000100:00100000:0.0:1788612556.417685:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893420544 00002000:00010000:0.0:1788612556.417727:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1788612556.417733:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928d853d9180 with x1875495893420544 ext(0->18446744073709551615) 00002000:00010000:0.0:1788612556.417746:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928d853d9180. 00000100:00100000:0.0:1788612556.417782:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:0.0:1788612556.417792:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2356:x1875495893420544:12345-192.168.202.6@tcp:10:bash.0 00002000:00010000:0.0:1788612556.418125:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788612556.418129:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788612555 -> 1788612556 00002000:00010000:0.0:1788612556.418147:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788612553 -> 1788612553 00002000:00010000:0.0:1788612556.418149:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788612555 -> 1788612556 00002000:00010000:0.0:1788612556.418152:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788612556.418378:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2356:x1875495893420544:12345-192.168.202.6@tcp:10:bash.0 Request processed in 576us (1086us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788612556.418386:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00002000:00010000:0.0:1788612556.418390:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1788612556.418393:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928d853d9180 with x1875495893420544 ext(0->18446744073709551615) 00002000:00010000:0.0:1788612556.418398:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928d853d9180. 00000100:00100000:3.0:1788612556.498800:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612556.498971:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893420672 00000100:00100000:1.0:1788612556.498980:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893420672 00000100:00100000:1.0:1788612556.499070:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 194 00000100:00100000:1.0:1788612556.499081:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+32:11543:x1875495893420672:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:1.0:1788612556.499155:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af42435 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499172:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af42435 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499202:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af42435 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499217:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4243c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499224:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4243c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499231:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4243c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499452:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499461:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499467:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612556.499504:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499513:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af42435 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499517:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af42435 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499522:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af42435 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499533:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612556.499536:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af42435 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499542:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af42435 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499551:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:1.0:1788612556.499553:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612556.499556:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af42435 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499560:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af42435 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499569:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4243c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499573:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4243c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499577:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4243c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499580:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612556.499581:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4243c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499584:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4243c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499594:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928e838cea00) 00010000:00010000:1.0:1788612556.499595:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612556.499597:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4243c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499600:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af4243c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499609:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499612:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42443 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499615:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499618:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612556.499620:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499623:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42443 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499627:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ceb00) 00010000:00010000:1.0:1788612556.499637:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612556.499639:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42443 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.499642:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42443 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612556.499707:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+32:11543:x1875495893420672:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 628us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612556.499712:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 194 00000100:00100000:3.0:1788612556.540288:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612556.541556:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893420928 00000100:00100000:2.0:1788612556.541585:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893420928 00000100:00100000:2.0:1788612556.541794:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 195 00000100:00100000:2.0:1788612556.541806:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+32:11546:x1875495893420928:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612556.541827:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612556.541872:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af4244a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb90 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.541955:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af42451 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.541970:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af42451 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.541983:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af42451 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542014:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af42458 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542022:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af42458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542028:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af42458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542309:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af4245f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542316:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af4245f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542321:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af4245f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612556.542333:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788612556.542435:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af42451 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542442:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af42451 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542446:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af42451 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542450:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612556.542454:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af42451 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542459:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af42451 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542467:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:2.0:1788612556.542469:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612556.542472:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af42451 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542476:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af42451 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542485:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af42458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542489:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af42458 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542499:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af42458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542502:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612556.542504:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af42458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542507:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af42458 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542511:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928e9231d800) 00010000:00010000:2.0:1788612556.542513:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612556.542514:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af42458 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542517:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af42458 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542553:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af4244a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb90 expref: 35 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542562:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af4245f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb90 expref: 34 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.542567:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ceb00) 00010000:00010000:2.0:1788612556.542568:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788612556.542570:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd12a00, rc 0) 00000100:00100000:2.0:1788612556.542725:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+34:11546:x1875495893420928:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 922us (2448us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788612556.542739:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 195 00000100:00100000:3.0:1788612556.545859:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612556.546084:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893421056 00000100:00100000:1.0:1788612556.546094:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893421056 00000100:00100000:1.0:1788612556.546220:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 196 00000100:00100000:1.0:1788612556.546231:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+34:11546:x1875495893421056:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:1.0:1788612556.546301:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.546316:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb7b expref: 34 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.546324:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.546357:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb7b expref: 34 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.546370:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb7b expref: 34 pid: 8316 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612556.546385:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90c55c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914382976:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612556.546659:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612556.549592:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90c55c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914382976:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612556.549630:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612556.554349:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612556.554467:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893421312 00000100:00100000:0.0:1788612556.554478:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893421312 00000100:00100000:0.0:1788612556.554534:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:0.0:1788612556.554544:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+35:5594:x1875495893421312:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788612556.554888:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+36:5594:x1875495893421312:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 344us (548us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788612556.554897:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:3.0:1788612556.558001:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612556.558263:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893421440 00000100:00100000:1.0:1788612556.558275:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893421440 00010000:00010000:1.0:1788612556.558323:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb7b expref: 36 pid: 8316 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612556.558369:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:1.0:1788612556.558388:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e92347050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+36:2356:x1875495893421440:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612556.558404:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612556.558411:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb7b expref: 36 pid: 8316 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.558425:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb7b expref: 36 pid: 8316 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.558445:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13400/0xfc956d548af42412 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb7b expref: 36 pid: 8316 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.558459:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ceb00) 00010000:00010000:1.0:1788612556.558464:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.558473:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.558480:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.558515:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612556.558586:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e92347050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+35:2356:x1875495893421440:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 198us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612556.558593:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 76 00010000:00010000:2.0:1788612556.558966:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.558975:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.559005:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.559012:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.559018:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.559023:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612556.559028:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.559045:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.559056:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ceb00) 00010000:00010000:2.0:1788612556.559059:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612556.559063:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.559069:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af4246d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612556.559126:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+34:11546:x1875495893421056:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 12896us (13299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612556.559142:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 196 00000100:00100000:0.0:1788612556.561616:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612556.561723:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893421696 00000100:00100000:3.0:1788612556.561732:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893421696 00000100:00100000:3.0:1788612556.561779:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:3.0:1788612556.561788:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+34:11546:x1875495893421696:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1788612556.562024:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+35:11546:x1875495893421696:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 237us (415us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788612556.562054:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:0.0:1788612556.675982:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612556.676370:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893421952 00000100:00100000:1.0:1788612556.676448:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893421952 00000100:00100000:1.0:1788612556.676560:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 197 00000100:00100000:1.0:1788612556.676572:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+35:11557:x1875495893421952:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:1.0:1788612556.676597:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612556.676621:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af42474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb97 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.676708:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af4247b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.676722:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af4247b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.676733:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af4247b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.676746:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af42482 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.676752:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af42482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.676758:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af42482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677275:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42489 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677296:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677305:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612556.677315:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788612556.677427:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af4247b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677434:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af4247b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677440:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af4247b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677447:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612556.677451:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af4247b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677459:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af4247b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677470:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:1.0:1788612556.677473:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612556.677477:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af4247b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677483:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60e00/0xfc956d548af4247b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677495:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af42482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677508:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af42482 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677513:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af42482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677517:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612556.677520:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af42482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677525:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af42482 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677532:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928e838cea00) 00010000:00010000:1.0:1788612556.677534:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612556.677537:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af42482 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677542:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af42482 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677586:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af42474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb97 expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677600:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb97 expref: 37 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.677607:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ceb00) 00010000:00010000:1.0:1788612556.677610:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612556.677618:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60800, rc 0) 00000100:00100000:1.0:1788612556.679331:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+37:11557:x1875495893421952:12345-192.168.202.6@tcp:101:cat.0 Request processed in 2752us (3350us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788612556.679346:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 197 00000100:00100000:2.0:1788612556.686336:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612556.686472:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893422208 00000100:00100000:3.0:1788612556.686482:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893422208 00000100:00100000:3.0:1788612556.686540:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:3.0:1788612556.686551:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+37:11557:x1875495893422208:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:3.0:1788612556.686803:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+38:11557:x1875495893422208:12345-192.168.202.6@tcp:35:cat.0 Request processed in 253us (482us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788612556.686811:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 54 00000100:00100000:2.0:1788612556.714323:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612556.714474:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893422464 00000100:00100000:3.0:1788612556.714486:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893422464 00000100:00100000:3.0:1788612556.714548:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 198 00000100:00100000:3.0:1788612556.714558:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+38:11558:x1875495893422464:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:3.0:1788612556.714652:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788612556.714681:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42489 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb97 expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.714704:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12a00/0xfc956d548af4245f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb90 expref: 37 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.714717:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42427 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb82 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.714727:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928e838ceb00) 00010000:00010000:3.0:1788612556.714739:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612556.714764:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.714793:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.714804:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.714820:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4249e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.714958:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4249e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.714966:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4249e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.715640:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.715652:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.715660:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788612556.716295:0:8316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788612556.716306:0:8316:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350559467456ns, next at 351559465450ns, rc = 0 00010000:00010000:3.0:1788612556.716367:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716388:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716408:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716416:0:8316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424ac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716422:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424ac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716428:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716443:0:8316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612556.716463:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716469:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424a5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716475:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716481:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612556.716485:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716493:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424a5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716504:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928ea7bbc800) 00010000:00010000:3.0:1788612556.716507:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788612556.716518:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424a5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716524:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424a5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716542:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716548:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42497 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716552:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716558:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612556.716560:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716567:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42497 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716574:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:3.0:1788612556.716576:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612556.716579:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42497 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.716585:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42497 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612556.716594:0:8316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047720df4 reply state 000000007e5a2708 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4249e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612556.716613:0:8316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788612556.716710:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+37:11558:x1875495893422464:12345-192.168.202.6@tcp:36:rm.0 Request processed in 2148us (2394us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788612556.716718:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 198 00010000:00010000:0.0:1788612556.717154:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612556.717164:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.717171:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612556.717175:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.717182:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.717203:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff928ea7bbc800) 00010000:00010000:0.0:1788612556.717206:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788612556.717209:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424ac lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.717214:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.717232:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612556.717234:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612556.717236:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612556.720272:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4249e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.720292:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4249e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.720300:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4249e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.720306:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612556.720311:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4249e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.720319:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4249e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.720339:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612556.720342:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612556.720347:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4249e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.720353:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4249e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612556.777298:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612556.777617:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893422720 00000100:00100000:3.0:1788612556.777628:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893422720 00000100:00100000:3.0:1788612556.777716:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 199 00000100:00100000:3.0:1788612556.777728:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+36:11564:x1875495893422720:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1788612556.777755:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612556.777778:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af424b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddb9e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.777952:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af424ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.777969:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af424ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.777981:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af424ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.777997:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.778005:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.778011:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788612556.778703:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788612556.778925:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af424c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.778937:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af424c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.778946:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af424c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.778994:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af424ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.779001:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af424ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.779008:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af424ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.779014:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612556.779020:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af424ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.779029:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af424ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.779056:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:3.0:1788612556.779060:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612556.779065:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af424ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.779072:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af424ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612556.779087:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023931c2f reply state 000000007bf452b6 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612556.779097:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788612556.779132:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af424b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb9e expref: 39 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.779162:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af424c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb9e expref: 38 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.779170:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc300) 00010000:00010000:3.0:1788612556.779172:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612556.779174:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030200, rc 0) 00000100:00100000:3.0:1788612556.779261:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+39:11564:x1875495893422720:12345-192.168.202.6@tcp:101:bash.0 Request processed in 1535us (1974us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788612556.779269:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 199 00010000:00010000:3.0:1788612556.782006:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.782025:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.782041:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.782047:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612556.782052:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.782060:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.782078:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612556.782081:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612556.782086:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.782107:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612556.785136:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612556.785234:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893422848 00000100:00100000:0.0:1788612556.785245:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893422848 00000100:00100000:0.0:1788612556.785307:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:0.0:1788612556.785317:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2356:x1875495893422848:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1788612556.785336:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612556.785358:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020502616/0xfc956d548af424d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddba5 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788612556.785394:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788612556.785414:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:0.0:1788612556.785419:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612556.785428:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020502616/0xfc956d548af424d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddba5 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.785447:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020502616/0xfc956d548af424d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddba5 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612556.785480:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf600, rc 0) 00000100:00100000:0.0:1788612556.785546:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893422848:12345-192.168.202.6@tcp:101:bash.0 Request processed in 230us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612556.785553:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:1.0:1788612556.793086:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612556.793189:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893422976 00000100:00100000:2.0:1788612556.793199:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893422976 00000100:00100000:2.0:1788612556.793260:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:2.0:1788612556.793270:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:11564:x1875495893422976:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1788612556.793288:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612556.793308:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddbac expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.793341:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000020502616/0xfc956d548af424d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddba5 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.793351:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612556.793356:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612556.793362:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.793408:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000020502616/0xfc956d548af424d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddba5 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.793423:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000020502616/0xfc956d548af424d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddba5 expref: 7 pid: 6697 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612556.793457:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7ba5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875495914383104:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612556.793547:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b723c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612556.796952:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7ba5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875495914383104:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612556.796991:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.797016:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd13e00, rc 0) 00000100:00100000:2.0:1788612556.797107:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:11564:x1875495893422976:12345-192.168.202.6@tcp:101:bash.0 Request processed in 3838us (4033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612556.797116:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:0.0:1788612556.801167:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612556.801268:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893423104 00000100:00100000:2.0:1788612556.801281:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893423104 00010000:00010000:2.0:1788612556.801329:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020502616/0xfc956d548af424d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddba5 expref: 7 pid: 6697 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612556.801479:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:2.0:1788612556.801494:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2355:x1875495893423104:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612556.801513:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612556.801539:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000020502616/0xfc956d548af424d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddba5 expref: 7 pid: 6697 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.801554:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000020502616/0xfc956d548af424d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddba5 expref: 7 pid: 6697 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.801598:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020502616/0xfc956d548af424d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddba5 expref: 7 pid: 6697 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.801627:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612556.801640:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612556.801649:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.801660:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.801697:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612556.801713:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7ba5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5837:1875495914383232:192.168.202.6@tcp:105: 00000100:00100000:2.0:1788612556.801806:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b723c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612556.804782:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7ba5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5837:1875495914383232:192.168.202.6@tcp:105: 00010000:00010000:2.0:1788612556.804809:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612556.804895:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2355:x1875495893423104:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 3396us (3731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612556.808019:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612556.808184:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893423360 00000100:00100000:0.0:1788612556.808194:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893423360 00000100:00100000:0.0:1788612556.808252:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:0.0:1788612556.808263:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+38:11564:x1875495893423360:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:0.0:1788612556.808632:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+39:11564:x1875495893423360:12345-192.168.202.6@tcp:35:bash.0 Request processed in 369us (622us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788612556.808649:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 55 00000100:00100000:2.0:1788612556.809745:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:0.0:1788612556.970064:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612556.970152:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893423488 00000100:00100000:3.0:1788612556.970162:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893423488 00000100:00100000:3.0:1788612556.970224:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 200 00000100:00100000:3.0:1788612556.970236:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+39:11580:x1875495893423488:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612556.970260:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612556.970283:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af424e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddbb3 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.970355:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.970369:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.970382:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612556.970427:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788612556.970432:0:8316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612556.970452:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.970477:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af424e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbb3 expref: 41 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.970520:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbb3 expref: 40 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.970529:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:3.0:1788612556.970532:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612556.970536:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030600, rc 0) 00000100:00100000:3.0:1788612556.970606:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+40:11580:x1875495893423488:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 373us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612556.970613:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 200 00000100:00100000:0.0:1788612556.976135:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612556.976214:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893423744 00000100:00100000:3.0:1788612556.976226:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893423744 00000100:00100000:3.0:1788612556.976292:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 201 00000100:00100000:3.0:1788612556.976303:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+40:11580:x1875495893423744:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612556.976322:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612556.976343:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af424f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddbba expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.976445:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.976460:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.976472:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612556.976482:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788612556.976629:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af424f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbba expref: 43 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.976658:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbba expref: 42 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.976667:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc300) 00010000:00010000:3.0:1788612556.976670:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612556.976673:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077200, rc 0) 00000100:00100000:3.0:1788612556.976736:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+42:11580:x1875495893423744:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 434us (611us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788612556.976743:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 201 00000100:00100000:1.0:1788612556.979414:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612556.979486:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893424000 00000100:00100000:3.0:1788612556.979496:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893424000 00000100:00100000:3.0:1788612556.979548:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 202 00000100:00100000:3.0:1788612556.979558:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+42:11580:x1875495893424000:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612556.979582:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612556.979601:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af42507 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddbc1 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.979703:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af4250e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.979716:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af4250e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.979728:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af4250e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612556.979755:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788612556.979899:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af42507 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbc1 expref: 45 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.979920:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af4250e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbc1 expref: 44 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.979929:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc300) 00010000:00010000:3.0:1788612556.979932:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788612556.979935:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077400, rc 0) 00000100:00100000:3.0:1788612556.979990:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+44:11580:x1875495893424000:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 433us (585us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788612556.979996:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 202 00000100:00100000:0.0:1788612556.985232:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612556.985427:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893424128 00000100:00100000:1.0:1788612556.985441:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893424128 00000100:00100000:1.0:1788612556.985513:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:1.0:1788612556.985525:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+44:2355:x1875495893424128:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612556.985543:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612556.985570:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af424f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbba expref: 44 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.985589:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc300) 00010000:00010000:1.0:1788612556.985594:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612556.985671:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+43:2355:x1875495893424128:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 148us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612556.985679:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:0.0:1788612556.988459:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612556.988558:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893424256 00000100:00100000:2.0:1788612556.988569:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893424256 00000100:00100000:2.0:1788612556.988635:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:2.0:1788612556.988655:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+6:2356:x1875495893424256:12345-192.168.202.6@tcp:1:lfs.0 00010000:00010000:2.0:1788612556.988724:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4251c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.988747:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.988756:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612556.988761:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788612556.988766:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4251c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.988806:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612556.988822:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 6 pid: 6695 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612556.988883:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7ba5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875495914383360:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612556.988962:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b723c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612556.994057:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7ba5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875495914383360:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612556.994092:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4251c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612556.995162:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612556.995350:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893424384 00000100:00100000:1.0:1788612556.995358:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893424384 00002000:00100000:1.0:1788612556.995415:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff928d8792df80 x1875495893424384/t0(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:202/0 lens 504/0 e 0 to 0 dl 1788612567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788612556.995444:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928d8792df80 with x1875495893424384 ext(0->8) 00010000:00010000:1.0:1788612556.995453:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 7 pid: 6695 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.995471:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 7 pid: 6695 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788612556.995479:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff928d8792df80 00000100:00100000:1.0:1788612556.995520:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:1.0:1788612556.995529:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2356:x1875495893424384:12345-192.168.202.6@tcp:4:lfs.0 00000100:00100000:1.0:1788612556.996052:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2356:x1875495893424384:12345-192.168.202.6@tcp:4:lfs.0 Request processed in 522us (894us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788612556.996062:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00002000:00100000:1.0:1788612556.996069:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff928d8792df80 x1875495893424384/t4294967308(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:202/0 lens 504/448 e 0 to 0 dl 1788612567 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788612556.996077:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928d8792df80 with x1875495893424384 ext(0->8) 00010000:00010000:1.0:1788612556.996083:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 9 pid: 6695 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.996095:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 9 pid: 6695 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788612556.996102:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff928d8792df80 00000100:00100000:2.0:1788612556.999144:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612556.999424:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893424512 00000100:00100000:1.0:1788612556.999453:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893424512 00010000:00010000:1.0:1788612556.999499:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 9 pid: 6695 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612556.999582:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:1.0:1788612556.999592:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2355:x1875495893424512:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612556.999608:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788612556.999628:0:11669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788612556.999631:0:11669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788612557 00002000:00010000:1.0:1788612556.999634:0:11669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788612557 00002000:00010000:1.0:1788612556.999644:0:11669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788612557 00010000:00010000:1.0:1788612556.999651:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 9 pid: 6695 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.999665:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 9 pid: 6695 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.999690:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af424dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbac expref: 9 pid: 6695 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.999707:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612556.999712:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612556.999718:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4251c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.999727:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4251c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612556.999778:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612556.999883:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2355:x1875495893424512:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 246us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612556.999890:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 78 00010000:00010000:3.0:1788612556.999948:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4251c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.999957:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4251c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.999984:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4251c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.999992:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4251c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612556.999999:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4251c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.000012:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612557.000017:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4251c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.000025:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4251c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.000050:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4251c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.000058:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4251c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612557.000105:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2356:x1875495893424256:12345-192.168.202.6@tcp:1:lfs.0 Request processed in 11452us (11659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612557.000112:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:2.0:1788612557.002757:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612557.002869:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893424768 00000100:00100000:0.0:1788612557.002880:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893424768 00000100:00100000:0.0:1788612557.002935:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 56 00000100:00100000:0.0:1788612557.002945:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e8347b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+43:11580:x1875495893424768:12345-192.168.202.6@tcp:35:lfs.0 00000004:00010000:0.0:1788612557.003008:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af4250e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbc1 expref: 43 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612557.003300:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788612557.003346:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788612557.007535:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788612557.007636:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612557.007657:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af424c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb9e expref: 47 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612557.007666:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612557.007708:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af424c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb9e expref: 47 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612557.007729:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af424c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb9e expref: 47 pid: 5853 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612557.007744:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1875495914383488:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612557.008486:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cde40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612557.010864:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612557.011030:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893424896 00000100:00100000:1.0:1788612557.011050:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893424896 00010000:00010000:1.0:1788612557.011092:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af424c8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb9e expref: 48 pid: 5853 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612557.011137:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:1.0:1788612557.011147:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+48:2356:x1875495893424896:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612557.011165:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612557.011171:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af424c8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb9e expref: 48 pid: 5853 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.011183:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af424c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb9e expref: 48 pid: 5853 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.011203:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc300) 00010000:00010000:1.0:1788612557.011208:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.011218:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.011225:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.011260:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612557.011311:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+48:2356:x1875495893424896:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 166us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612557.011318:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 79 00010000:00010000:3.0:1788612557.013096:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af424c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb9e expref: 47 pid: 5853 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612557.013121:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1875495914383488:192.168.202.6@tcp:104: 00010000:00010000:3.0:1788612557.013157:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.013167:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.013193:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612557.013320:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788612557.013594:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1788612557.013767:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d853d8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875495914383616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788612557.015530:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612557.015652:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e922f93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612557.015792:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914383616 00000100:00100000:1.0:1788612557.015802:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914383616 00000100:00100000:1.0:1788612557.016004:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612557.016014:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1875495914383616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788612557.016138:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1875495914383616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 125us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612557.016145:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612557.016190:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d853d8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875495914383616:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788612557.016917:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788612557.016999:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0749180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875495914383744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788612557.017058:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788612557.017150:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612557.017205:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612557.017303:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914383744 00000100:00100000:2.0:1788612557.017310:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914383744 00000100:00100000:2.0:1788612557.017455:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612557.017466:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1875495914383744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788612557.017750:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0749180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875495914383744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788612557.017809:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788612557.017870:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.017882:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.017889:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.017909:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612557.017913:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.017922:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.017939:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc300) 00010000:00010000:1.0:1788612557.017942:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788612557.017947:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.017954:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde600/0xfc956d548af42523 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788612557.018152:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788612557.018250:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788612557.018261:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350861423340ns, next at 351861420611ns, rc = 0 00000001:00080000:1.0:1788612557.018269:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788612557.018301:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc300) 00010000:00010000:1.0:1788612557.018304:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788612557.018311:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af4250e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbc1 expref: 51 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612557.018495:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e8347b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+50:11580:x1875495893424768:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 15549us (15746us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788612557.018504:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 56 00000020:00080000:1.0:1788612557.018510:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788612557.018623:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5855:x1875495914383744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1158us (1563us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788612557.018703:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612557.021205:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612557.021272:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893425024 00000100:00100000:3.0:1788612557.021282:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893425024 00000100:00100000:3.0:1788612557.021341:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 203 00000100:00100000:3.0:1788612557.021352:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+50:11580:x1875495893425024:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612557.021387:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612557.021410:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af4252a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddbc8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.021475:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af4252a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbc8 expref: 51 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.021490:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af4252a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbc8 expref: 51 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.021508:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612557.021511:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612557.021515:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0076000, rc 0) 00000100:00100000:3.0:1788612557.022195:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+51:11580:x1875495893425024:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 286us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612557.022221:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 203 00000100:00100000:0.0:1788612557.026083:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612557.026174:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893425280 00000100:00100000:3.0:1788612557.026185:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893425280 00000100:00100000:3.0:1788612557.026349:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:3.0:1788612557.026360:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+51:11580:x1875495893425280:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1788612557.026657:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:11580:x1875495893425280:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 289us (574us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788612557.026665:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 57 00000100:00100000:0.0:1788612557.135293:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612557.135360:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893425408 00000100:00100000:3.0:1788612557.135371:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893425408 00000100:00100000:3.0:1788612557.135443:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 204 00000100:00100000:3.0:1788612557.135454:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:11590:x1875495893425408:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:3.0:1788612557.135543:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af42531 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135560:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af42531 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135572:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af42531 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135586:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42538 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135593:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135599:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135705:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4253f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135711:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4253f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135716:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4253f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612557.135747:0:8316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4253f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135755:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af42531 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135760:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af42531 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135764:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af42531 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135768:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612557.135771:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af42531 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135775:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af42531 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135782:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:3.0:1788612557.135784:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612557.135788:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af42531 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135796:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af42531 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135806:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135809:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42538 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135813:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135816:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0077200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612557.135818:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135821:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42538 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135825:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928ea7bbc500) 00010000:00010000:3.0:1788612557.135826:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612557.135829:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42538 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.135834:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42538 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.136163:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4253f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.136169:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4253f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.136182:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4253f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.136187:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612557.136190:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4253f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.136196:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4253f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.136204:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612557.136206:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612557.136208:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4253f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.136212:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4253f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612557.136279:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:11590:x1875495893425408:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 825us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612557.136286:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 204 00000100:00100000:1.0:1788612557.195440:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612557.196350:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893425664 00000100:00100000:2.0:1788612557.196362:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893425664 00000100:00100000:2.0:1788612557.196436:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 205 00000100:00100000:2.0:1788612557.196447:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+52:11593:x1875495893425664:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612557.196467:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612557.196488:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af42546 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddbcf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.196581:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af4254d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.196596:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af4254d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.196609:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af4254d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.196634:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12600/0xfc956d548af42554 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.196643:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12600/0xfc956d548af42554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.196649:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12600/0xfc956d548af42554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.196766:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4255b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.196783:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4255b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.196790:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4255b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612557.196799:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788612557.197195:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af4254d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197204:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af4254d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197211:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af4254d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197217:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612557.197223:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af4254d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197230:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af4254d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197242:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:2.0:1788612557.197245:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612557.197249:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af4254d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197256:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af4254d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197269:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12600/0xfc956d548af42554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197283:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12600/0xfc956d548af42554 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197288:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12600/0xfc956d548af42554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197293:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612557.197297:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12600/0xfc956d548af42554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197303:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12600/0xfc956d548af42554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197311:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928e9231d800) 00010000:00010000:2.0:1788612557.197313:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612557.197316:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12600/0xfc956d548af42554 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197322:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12600/0xfc956d548af42554 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197368:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af42546 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbcf expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197391:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4255b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbcf expref: 54 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.197399:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:2.0:1788612557.197401:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612557.197408:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd13e00, rc 0) 00000100:00100000:2.0:1788612557.197479:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:11593:x1875495893425664:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1033us (2048us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788612557.197486:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 205 00000100:00100000:0.0:1788612557.204690:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612557.204776:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893425792 00000100:00100000:2.0:1788612557.204788:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893425792 00000100:00100000:2.0:1788612557.204902:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 206 00000100:00100000:2.0:1788612557.204913:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:11593:x1875495893425792:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:2.0:1788612557.204983:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af42569 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.205015:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af42569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.205030:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af42569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.205070:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af42569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.205077:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af42569 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.205084:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af42569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.205090:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12e00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612557.205094:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af42569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.205101:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af42569 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.205128:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:2.0:1788612557.205130:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612557.205135:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af42569 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.205140:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af42569 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612557.205214:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:11593:x1875495893425792:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 302us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612557.205222:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 206 00000100:00100000:0.0:1788612557.208161:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612557.208275:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893426048 00000100:00100000:1.0:1788612557.208285:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893426048 00000100:00100000:1.0:1788612557.208347:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:1.0:1788612557.208356:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+54:11593:x1875495893426048:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1788612557.208895:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:11593:x1875495893426048:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 537us (742us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788612557.208903:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 58 00000100:00100000:1.0:1788612557.297021:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612557.297299:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893426304 00000100:00100000:3.0:1788612557.297310:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893426304 00000100:00100000:3.0:1788612557.297376:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 207 00000100:00100000:3.0:1788612557.297387:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:11604:x1875495893426304:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1788612557.297412:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612557.297416:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788612557.297446:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af424eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbb3 expref: 55 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.297485:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:3.0:1788612557.297491:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612557.297515:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42570 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddbd6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.297609:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.297623:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4255b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbcf expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.297632:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.297665:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4255b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbcf expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.297678:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4255b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbcf expref: 55 pid: 5854 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612557.297692:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d853d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914383872:192.168.202.6@tcp:104: 00000100:00100000:3.0:1788612557.297789:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e87104840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612557.304566:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d853d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914383872:192.168.202.6@tcp:104: 00010000:00010000:3.0:1788612557.304598:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612557.305239:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612557.305880:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893426432 00000100:00100000:2.0:1788612557.305888:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893426432 00010000:00010000:2.0:1788612557.305931:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4255b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbcf expref: 56 pid: 5854 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612557.305973:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:2.0:1788612557.305983:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+56:2356:x1875495893426432:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612557.305998:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612557.306006:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4255b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbcf expref: 56 pid: 5854 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.306019:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4255b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbcf expref: 56 pid: 5854 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.306050:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4255b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbcf expref: 56 pid: 5854 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.306082:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:2.0:1788612557.306088:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.306099:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.306108:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.306138:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612557.306202:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:2356:x1875495893426432:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 218us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612557.306209:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 80 00010000:00010000:3.0:1788612557.306285:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.306300:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612557.306318:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788612557.306483:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42570 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbd6 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.306499:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbd6 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.306516:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612557.306519:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788612557.306521:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e80030000, rc 0) 00000100:00100000:3.0:1788612557.306560:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:11604:x1875495893426304:12345-192.168.202.6@tcp:101:bash.0 Request processed in 9175us (9549us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788612557.306567:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 207 00000100:00100000:1.0:1788612557.311152:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612557.311227:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893426688 00000100:00100000:2.0:1788612557.311239:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893426688 00000100:00100000:2.0:1788612557.311306:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 208 00000100:00100000:2.0:1788612557.311317:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+55:11604:x1875495893426688:12345-192.168.202.6@tcp:36:bash.0 00010000:00010000:2.0:1788612557.311595:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af42585 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.311614:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af42585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.311626:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af42585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788612557.311692:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788612557.311717:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3b68ccc reply state 0000000096b05373 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af42585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612557.311740:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788612557.311877:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+58:11604:x1875495893426688:12345-192.168.202.6@tcp:36:bash.0 Request processed in 561us (735us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788612557.311884:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 208 00000020:00080000:2.0:1788612557.311889:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788612557.314626:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af42585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.314658:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af42585 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.314666:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af42585 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.314672:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612557.314677:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af42585 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.314705:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af42585 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.314723:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612557.314726:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612557.314731:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af42585 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.314737:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af42585 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612557.317193:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612557.317408:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893426816 00000100:00100000:2.0:1788612557.317420:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893426816 00000100:00100000:2.0:1788612557.317483:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 209 00000100:00100000:2.0:1788612557.317495:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:11604:x1875495893426816:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:2.0:1788612557.317531:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612557.317554:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4258c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddbdd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.317650:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.317665:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbd6 expref: 58 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.317673:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.317708:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbd6 expref: 58 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.317722:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbd6 expref: 58 pid: 5853 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612557.317756:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7ba5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914384000:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612557.317897:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b723c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612557.320137:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7ba5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875495914384000:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612557.320165:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612557.321430:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612557.321523:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893426944 00000100:00100000:0.0:1788612557.321532:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893426944 00010000:00010000:0.0:1788612557.321585:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbd6 expref: 59 pid: 5853 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612557.321629:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:0.0:1788612557.321643:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:2356:x1875495893426944:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612557.321659:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612557.321667:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbd6 expref: 59 pid: 5853 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612557.321680:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbd6 expref: 59 pid: 5853 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612557.321702:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af42577 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbd6 expref: 59 pid: 5853 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612557.321719:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:0.0:1788612557.321724:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612557.321734:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612557.321742:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612557.321773:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612557.321830:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+58:2356:x1875495893426944:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 193us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612557.321867:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00010000:00010000:1.0:1788612557.322120:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.322128:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612557.322176:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788612557.322181:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788612557.322203:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.322233:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13e00/0xfc956d548af4258c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbdd expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.322256:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbdd expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.322264:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:1.0:1788612557.322266:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612557.322269:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd12000, rc 0) 00000100:00100000:1.0:1788612557.322297:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:11604:x1875495893426816:12345-192.168.202.6@tcp:101:bash.0 Request processed in 4804us (5116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612557.322303:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 209 00000100:00100000:2.0:1788612557.326693:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612557.326977:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893427200 00000100:00100000:3.0:1788612557.326990:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893427200 00000100:00100000:3.0:1788612557.327061:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:3.0:1788612557.327071:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+57:11604:x1875495893427200:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:3.0:1788612557.327362:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+58:11604:x1875495893427200:12345-192.168.202.6@tcp:35:bash.0 Request processed in 291us (679us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788612557.327369:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 59 00000100:00100000:3.0:1788612557.404290:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612557.404755:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893427328 00000100:00100000:2.0:1788612557.404768:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893427328 00000100:00100000:2.0:1788612557.404872:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 210 00000100:00100000:2.0:1788612557.404882:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+58:11610:x1875495893427328:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612557.404907:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612557.404929:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af4259a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddbe4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.404997:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af425a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.405011:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af425a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.405023:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af425a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612557.405069:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788612557.405073:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612557.405091:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af425a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.405117:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af4259a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbe4 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.405158:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af425a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbe4 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.405167:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:2.0:1788612557.405169:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612557.405173:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd13a00, rc 0) 00000100:00100000:2.0:1788612557.405240:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:11610:x1875495893427328:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 359us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612557.405247:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 210 00000100:00100000:0.0:1788612557.419948:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612557.420615:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893427456 00000100:00100000:3.0:1788612557.420626:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893427456 00000100:00100000:3.0:1788612557.420705:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 211 00000100:00100000:3.0:1788612557.420716:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:11610:x1875495893427456:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612557.420737:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612557.420759:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af425a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddbeb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.420896:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af425af lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.420911:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af425af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.420922:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af425af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.420936:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af425b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.420943:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af425b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.420948:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af425b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421048:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af425bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421057:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af425bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421063:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af425bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612557.421098:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788612557.421103:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612557.421121:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af425bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421144:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af425bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421152:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af425af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421158:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af425af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421164:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af425af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421169:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612557.421173:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af425af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421180:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af425af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421191:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:3.0:1788612557.421194:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612557.421198:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af425af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421204:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af425af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421216:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af425b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421221:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af425b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421232:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af425b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421237:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612557.421239:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af425b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421245:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af425b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421252:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928ea7bbc500) 00010000:00010000:3.0:1788612557.421255:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612557.421726:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af425b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421736:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af425b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421773:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af425a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbeb expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421788:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af425bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbeb expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.421795:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612557.422003:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612557.422007:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077200, rc 0) 00000100:00100000:1.0:1788612557.422244:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+60:11610:x1875495893427456:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1527us (2304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612557.422253:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 211 00010000:00010000:0.0:1788612557.422621:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612557.428595:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612557.428861:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893427712 00000100:00100000:2.0:1788612557.428872:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893427712 00000100:00100000:2.0:1788612557.428933:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 212 00000100:00100000:2.0:1788612557.428943:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+60:11610:x1875495893427712:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612557.428964:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612557.428985:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af425c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddbf2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.429104:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.429120:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbdd expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.429127:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af425bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbeb expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.429156:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.429192:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af425bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbeb expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.429206:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af425bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbeb expref: 61 pid: 5853 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612557.429220:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7ba5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914384128:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612557.429503:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbdd expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.429513:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbdd expref: 61 pid: 5854 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612557.429591:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914384256:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612557.429618:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72540 going to sleep for 11 seconds 00000100:00100000:2.0:1788612557.434202:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612557.434374:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893427840 00000100:00100000:3.0:1788612557.434394:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893427840 00010000:00010000:3.0:1788612557.434455:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af425bd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbeb expref: 62 pid: 5853 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612557.434502:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:3.0:1788612557.434528:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e92347450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+62:2353:x1875495893427840:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612557.434544:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612557.434551:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af425bd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbeb expref: 62 pid: 5853 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.434564:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af425bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbeb expref: 62 pid: 5853 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.434587:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612557.434593:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.434603:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.434610:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612557.435009:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e92347450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+62:2353:x1875495893427840:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 487us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612557.435017:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 82 00010000:00010000:1.0:1788612557.435241:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af425bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbeb expref: 61 pid: 5853 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612557.435257:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7ba5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914384128:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612557.435282:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914384256:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612557.435305:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612557.439778:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612557.444987:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893427968 00000100:00100000:1.0:1788612557.445005:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893427968 00010000:00010000:1.0:1788612557.445075:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbdd expref: 61 pid: 5854 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612557.445125:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00100000:1.0:1788612557.445153:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:2354:x1875495893427968:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612557.445168:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612557.445174:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbdd expref: 61 pid: 5854 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.445188:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbdd expref: 61 pid: 5854 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.445208:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12000/0xfc956d548af42593 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbdd expref: 61 pid: 5854 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.445226:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:1.0:1788612557.445231:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.445241:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.445249:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.446052:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612557.446121:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+60:2354:x1875495893427968:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 967us (6628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612557.446130:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 83 00010000:00010000:2.0:1788612557.446217:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.446226:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612557.446243:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788612557.446422:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af425c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf2 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.446455:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf2 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.446463:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:2.0:1788612557.446467:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788612557.446470:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd12c00, rc 0) 00000100:00100000:2.0:1788612557.446512:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+60:11610:x1875495893427712:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 17556us (17913us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788612557.447058:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 212 00000100:00100000:2.0:1788612557.452393:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612557.452789:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893428224 00000100:00100000:3.0:1788612557.452801:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893428224 00000100:00100000:3.0:1788612557.452988:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:3.0:1788612557.453001:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+60:11610:x1875495893428224:12345-192.168.202.6@tcp:103:lfs.0 00010000:00010000:3.0:1788612557.453019:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612557.453070:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af4252a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbc8 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.453091:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612557.453097:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612557.453195:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:11610:x1875495893428224:12345-192.168.202.6@tcp:103:lfs.0 Request processed in 196us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612557.453203:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:0.0:1788612557.459101:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612557.459180:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893428352 00000100:00100000:1.0:1788612557.459192:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893428352 00000100:00100000:1.0:1788612557.459257:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 213 00000100:00100000:1.0:1788612557.459275:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:11610:x1875495893428352:12345-192.168.202.6@tcp:58:lfs.0 00010000:00010000:1.0:1788612557.459401:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af425d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.459419:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af425d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.459431:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af425d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612557.460067:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788612557.460266:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:11610:x1875495893428352:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 982us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612557.460276:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 213 00000100:00100000:2.0:1788612557.464356:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612557.464426:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893428480 00000100:00100000:3.0:1788612557.464437:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893428480 00000100:00100000:3.0:1788612557.464514:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 214 00000100:00100000:3.0:1788612557.464532:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+59:11610:x1875495893428480:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612557.464556:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612557.464578:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af425e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddbf9 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.464633:0:8316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af425d9 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.464653:0:8316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af425e0 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf9 expref: 60 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.464680:0:8316:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af425d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.464695:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af425e0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf9 expref: 60 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.464709:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612557.464719:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612557.464723:0:8316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af425e0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf9 expref: 60 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.464731:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077400, rc 0) 00000100:00100000:3.0:1788612557.466005:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+60:11610:x1875495893428480:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1473us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612557.466016:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 214 00000040:00080000:2.0:1788612557.869315:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788612557.869329:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612557.869368:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788612557.869377:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788612557.869510:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b84700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875495914384384:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788612557.869771:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72540 going to sleep for 11 seconds 00000100:00100000:0.0:1788612557.876654:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612557.876876:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893428608 00000100:00100000:1.0:1788612557.876887:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893428608 00000100:00100000:1.0:1788612557.876967:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 215 00000100:00100000:1.0:1788612557.876978:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:11611:x1875495893428608:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788612557.877014:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788612557.877145:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:11611:x1875495893428608:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 168us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612557.877154:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 215 00000100:00100000:2.0:1788612557.878135:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b84700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875495914384384:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788612557.887487:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612557.887593:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893428736 00000100:00100000:2.0:1788612557.887604:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893428736 00000100:00100000:2.0:1788612557.887683:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 216 00000100:00100000:2.0:1788612557.887693:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+60:11611:x1875495893428736:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788612557.887767:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af425e7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.887797:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af425e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.887819:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af425e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888039:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af425ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888057:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af425ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888064:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af425ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888087:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af425f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888095:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af425f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888101:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af425f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612557.888136:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788612557.888140:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612557.888154:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af425f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888165:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af425e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888182:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af425e7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888189:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af425e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888194:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612557.888199:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af425e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888206:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af425e7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888218:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb600) 00010000:00010000:2.0:1788612557.888221:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612557.888225:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af425e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888232:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13600/0xfc956d548af425e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888244:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af425ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888249:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af425ee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888255:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af425ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888260:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612557.888267:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af425ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888274:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af425ee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888281:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff928e9231d800) 00010000:00010000:2.0:1788612557.888284:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612557.888286:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af425ee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888291:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af425ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888309:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af425f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888314:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af425f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888320:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af425f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888324:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612557.888326:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af425f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888331:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af425f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888337:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:2.0:1788612557.888339:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612557.888346:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af425f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.888352:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af425f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612557.888752:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+60:11611:x1875495893428736:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 1056us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612557.888762:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 216 00000100:00100000:0.0:1788612557.903292:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612557.903399:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893428992 00000100:00100000:1.0:1788612557.903409:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893428992 00000100:00100000:1.0:1788612557.903472:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 217 00000100:00100000:1.0:1788612557.903482:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+60:11611:x1875495893428992:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612557.903501:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612557.903521:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af425fc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc00 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.903648:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.903664:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.903676:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612557.903688:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788612557.903785:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.903793:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42603 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.903800:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.903820:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612557.903825:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.903832:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42603 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.903875:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:1.0:1788612557.903878:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788612557.903884:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42603 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.903912:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42603 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.903963:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af425fc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc00 expref: 62 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.903974:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb600) 00010000:00010000:1.0:1788612557.903977:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612557.903981:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af425fc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc00 expref: 62 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.903990:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60000, rc 0) 00000100:00100000:1.0:1788612557.904069:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:11611:x1875495893428992:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 587us (788us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1788612557.904077:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 217 00000100:00100000:0.0:1788612557.907694:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612557.907997:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893429120 00000100:00100000:3.0:1788612557.908009:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893429120 00000100:00100000:3.0:1788612557.908082:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 218 00000100:00100000:3.0:1788612557.908093:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:11611:x1875495893429120:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788612557.908142:0:8316:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788612557.908248:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:11611:x1875495893429120:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 157us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612557.908255:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 218 00000100:00100000:0.0:1788612557.912185:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612557.912430:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893429376 00000100:00100000:1.0:1788612557.912440:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893429376 00000100:00100000:1.0:1788612557.912498:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 219 00000100:00100000:1.0:1788612557.912507:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec03af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:11611:x1875495893429376:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612557.912529:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612557.912533:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788612557.912558:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13a00/0xfc956d548af425a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbe4 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.912579:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:1.0:1788612557.912583:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612557.912611:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42611 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc07 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788612557.913203:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788612557.913418:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af42618 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.913433:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af42618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.913443:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af42618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.913500:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42611 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc07 expref: 63 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.913518:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af42618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc07 expref: 62 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.913525:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff928e838cea00) 00010000:00010000:1.0:1788612557.913528:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612557.913531:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60400, rc 0) 00000100:00100000:1.0:1788612557.913604:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec03af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+62:11611:x1875495893429376:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1098us (1430us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788612557.913611:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 219 00000100:00100000:0.0:1788612557.925229:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612557.925529:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893429632 00000100:00100000:3.0:1788612557.925540:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893429632 00000100:00100000:3.0:1788612557.925601:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 220 00000100:00100000:3.0:1788612557.925612:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+62:11611:x1875495893429632:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788612557.925798:0:8316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612557.926198:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af42618 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc07 expref: 62 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.926218:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff928e838cea00) 00010000:00010000:3.0:1788612557.926229:0:8316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612557.927180:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af42626 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927203:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af42626 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927214:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af42626 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927233:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af4262d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x384cddf5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927240:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af4262d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x384cddf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927245:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af4262d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x384cddf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927324:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af42626 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927331:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af42626 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927352:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af42626 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927358:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612557.927362:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af42626 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927370:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af42626 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927380:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:2.0:1788612557.927458:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612557.927465:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af42626 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927472:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13800/0xfc956d548af42626 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927484:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af4262d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x384cddf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927490:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af4262d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x384cddf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927495:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af4262d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x384cddf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927500:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612557.927503:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af4262d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x384cddf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927524:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af4262d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x384cddf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927533:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x384cddf5 (ffff928e9231d800) 00010000:00010000:2.0:1788612557.927536:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612557.927539:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af4262d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x384cddf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612557.927544:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12800/0xfc956d548af4262d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x384cddf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612557.932590:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:11611:x1875495893429632:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 6965us (7359us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788612557.932606:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 220 00000100:00100000:0.0:1788612557.963389:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612557.963584:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893429760 00000100:00100000:1.0:1788612557.963595:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893429760 00000100:00100000:1.0:1788612557.963657:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 221 00000100:00100000:1.0:1788612557.963668:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+61:11611:x1875495893429760:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612557.963708:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612557.963732:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42634 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc0e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.963769:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4263b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.963783:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4263b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.963795:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4263b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.963940:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42634 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc0e expref: 63 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.963961:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4263b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc0e expref: 62 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.963971:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff928e838ce700) 00010000:00010000:1.0:1788612557.963974:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788612557.963978:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60000, rc 0) 00000100:00100000:1.0:1788612557.964030:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+62:11611:x1875495893429760:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 363us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612557.964038:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 221 00000100:00100000:2.0:1788612557.985751:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612557.985872:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893430016 00000100:00100000:1.0:1788612557.985884:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893430016 00000100:00100000:1.0:1788612557.985950:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 222 00000100:00100000:1.0:1788612557.985961:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+62:11611:x1875495893430016:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788612557.986081:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42642 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.986100:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612557.986112:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612557.986374:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1788612557.987747:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351830907766ns, next at 352830898811ns, rc = 0 00000004:00010000:1.0:1788612557.987974:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be667f22 reply state 0000000090212be2 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612557.987985:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612557.988104:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+64:11611:x1875495893430016:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 2140us (2362us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788612557.988113:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 222 00010000:00010000:3.0:1788612557.996659:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.996679:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42642 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.996687:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.996692:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612557.996697:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.996704:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42642 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.996724:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff928e838ce700) 00010000:00010000:3.0:1788612557.996727:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788612557.996734:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42642 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612557.996740:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60c00/0xfc956d548af42642 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612557.999382:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612557.999785:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893430144 00000100:00100000:1.0:1788612557.999798:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893430144 00000100:00100000:1.0:1788612557.999910:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 223 00000100:00100000:1.0:1788612557.999921:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+63:11611:x1875495893430144:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612557.999952:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612557.999979:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42649 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc15 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.000062:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42649 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc15 expref: 64 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.000104:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42649 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc15 expref: 64 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.000128:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff928e838ce700) 00010000:00010000:1.0:1788612558.000131:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612558.000135:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60800, rc 0) 00000100:00100000:1.0:1788612558.000210:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+64:11611:x1875495893430144:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 291us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612558.000217:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 223 00000100:00100000:0.0:1788612558.007164:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612558.012038:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893430272 00000100:00100000:2.0:1788612558.012066:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893430272 00000100:00100000:2.0:1788612558.012207:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:2.0:1788612558.012220:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec07de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2356:x1875495893430272:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788612558.012581:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec07de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+10:2356:x1875495893430272:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 363us (5427us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788612558.012589:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:1.0:1788612558.015460:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612558.015660:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893430528 00000100:00100000:3.0:1788612558.015672:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893430528 00000100:00080000:0.0:1788612558.015760:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612558.016083:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612558.016233:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:3.0:1788612558.016244:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+64:11611:x1875495893430528:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788612558.016550:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+65:11611:x1875495893430528:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 306us (1099us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788612558.016558:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:1.0:1788612558.019537:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612558.019638:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893430784 00000100:00100000:2.0:1788612558.019707:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893430784 00000100:00100000:2.0:1788612558.019812:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 224 00000100:00100000:2.0:1788612558.019824:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+65:11611:x1875495893430784:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788612558.019994:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+65:11611:x1875495893430784:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 172us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612558.020002:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 224 00000100:00100000:1.0:1788612558.022594:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612558.022699:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893430912 00000100:00100000:3.0:1788612558.022709:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893430912 00000100:00100000:3.0:1788612558.022769:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 225 00000100:00100000:3.0:1788612558.022778:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+65:11611:x1875495893430912:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612558.022797:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612558.022834:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af42650 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc1c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.022966:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.022981:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.022993:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612558.023027:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612558.023057:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.023083:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af42650 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc1c expref: 67 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.023101:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc1c expref: 66 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.023110:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff928e838ce700) 00010000:00010000:3.0:1788612558.023113:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788612558.023117:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077200, rc 0) 00000100:00100000:3.0:1788612558.023177:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+66:11611:x1875495893430912:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 400us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612558.023184:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 225 00000100:00100000:0.0:1788612558.026126:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612558.026274:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893431040 00000100:00100000:1.0:1788612558.026285:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893431040 00000100:00100000:1.0:1788612558.026350:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:1.0:1788612558.026360:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+10:2356:x1875495893431040:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612558.026388:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612558.026413:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa10a704/0xfc956d548af4265e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc23 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788612558.026441:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c0fce, blocks: 0x1 00010000:00010000:1.0:1788612558.026462:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1788612558.026467:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612558.026477:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa10a704/0xfc956d548af4265e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc23 expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.026512:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa10a704/0xfc956d548af4265e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc23 expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.026526:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61800, rc 0) 00000100:00100000:1.0:1788612558.026589:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:2356:x1875495893431040:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 230us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612558.026596:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:0.0:1788612558.032747:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612558.032893:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893431296 00000100:00100000:1.0:1788612558.032905:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893431296 00000100:00100000:1.0:1788612558.032965:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 226 00000100:00100000:1.0:1788612558.032975:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+66:11611:x1875495893431296:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788612558.033126:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+66:11611:x1875495893431296:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 152us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612558.033135:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 226 00000100:00100000:3.0:1788612558.041319:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612558.041438:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893431424 00000100:00100000:1.0:1788612558.041450:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893431424 00000100:00100000:1.0:1788612558.041515:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:1.0:1788612558.041526:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:11611:x1875495893431424:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612558.041544:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612558.041562:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a47117c/0xfc956d548af42665 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc2a expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.041593:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa10a704/0xfc956d548af4265e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc23 expref: 12 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.041616:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612558.041620:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612558.041625:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a47117c/0xfc956d548af42665 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc2a expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.041669:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa10a704/0xfc956d548af4265e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc23 expref: 12 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.041682:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa10a704/0xfc956d548af4265e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc23 expref: 12 pid: 6695 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612558.041697:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec082b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875495914384512:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612558.041792:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a26480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612558.045443:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612558.045533:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893431552 00000100:00100000:2.0:1788612558.045543:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893431552 00010000:00010000:2.0:1788612558.045582:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa10a704/0xfc956d548af4265e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc23 expref: 13 pid: 6695 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612558.045630:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:2.0:1788612558.045641:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:2356:x1875495893431552:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612558.045666:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612558.045693:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa10a704/0xfc956d548af4265e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc23 expref: 13 pid: 6695 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.045706:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa10a704/0xfc956d548af4265e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc23 expref: 13 pid: 6695 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.045729:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612558.045733:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612558.045740:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a47117c/0xfc956d548af42665 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc2a expref: 13 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.045751:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a47117c/0xfc956d548af42665 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc2a expref: 13 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.045784:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001a47117c/0xfc956d548af42665 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc2a expref: 13 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612558.045823:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b85880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5839:1875495914384640:192.168.202.6@tcp:105: 00000100:00100000:2.0:1788612558.046114:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72540 going to sleep for 11 seconds 00010000:00010000:1.0:1788612558.047603:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa10a704/0xfc956d548af4265e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc23 expref: 13 pid: 6695 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612558.047636:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec082b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875495914384512:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612558.047671:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a47117c/0xfc956d548af42665 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc2a expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.047686:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60200, rc 0) 00000100:00100000:1.0:1788612558.047755:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+12:11611:x1875495893431424:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 6231us (6449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612558.047781:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:2.0:1788612558.052527:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b85880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5839:1875495914384640:192.168.202.6@tcp:105: 00010000:00010000:2.0:1788612558.052560:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612558.052628:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:2356:x1875495893431552:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 6989us (7196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612558.052639:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:0.0:1788612558.065963:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612558.066127:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893431680 00000100:00100000:3.0:1788612558.066139:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893431680 00002000:00100000:3.0:1788612558.066194:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff928eacd5aa00 x1875495893431680/t0(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:204/0 lens 504/0 e 0 to 0 dl 1788612569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612558.066206:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928eacd5aa00 with x1875495893431680 ext(0->12) 00002000:00010000:3.0:1788612558.066211:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928eacd5aa00 00000100:00100000:3.0:1788612558.066235:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:3.0:1788612558.066246:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+11:2355:x1875495893431680:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788612558.066739:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:2355:x1875495893431680:12345-192.168.202.6@tcp:4:lhsmtool_posix.0 Request processed in 493us (784us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788612558.066748:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00002000:00100000:3.0:1788612558.066756:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff928eacd5aa00 x1875495893431680/t4294967320(0) o4->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:204/0 lens 504/448 e 0 to 0 dl 1788612569 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788612558.066765:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928eacd5aa00 with x1875495893431680 ext(0->12) 00002000:00010000:3.0:1788612558.066769:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928eacd5aa00 00000100:00100000:3.0:1788612558.070050:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612558.070218:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893431808 00000100:00100000:1.0:1788612558.070228:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893431808 00000100:00100000:1.0:1788612558.070287:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 227 00000100:00100000:1.0:1788612558.070297:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+66:11611:x1875495893431808:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788612558.118182:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967489 is committed 00000020:00080000:3.0:1788612558.118217:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1788612558.118240:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1788612558.118246:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:3.0:1788612558.118271:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788612558.118291:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff928ec00dcf00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788612558.118313:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928ec070f800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff928ec00dc600 00000020:00080000:3.0:1788612558.118317:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928ea7b77500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff928e8301c800 00000001:00080000:3.0:1788612558.118349:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788612558.118372:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:2.0:1788612558.118473:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788612558.118484:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788612558.118518:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff928e91c25cc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788612558.118522:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928ec00c4d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff928e91c25b40 00000020:00080000:3.0:1788612558.118525:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928ec00c4e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff928d87929000 00000100:00100000:3.0:1788612558.118728:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d853db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914384768:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788612558.118797:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788612558.119058:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788612558.119247:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788612558.119371:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d853d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914384896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788612558.119545:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612558.119614:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612558.119620:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d853d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914385024:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788612558.119642:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612558.120150:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914384768 00000100:00100000:1.0:1788612558.120159:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914384768 00000100:00080000:2.0:1788612558.120234:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612558.120271:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914384896 00000100:00100000:0.0:1788612558.120276:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914384896 00000100:00100000:0.0:1788612558.120307:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914385024 00000100:00100000:0.0:1788612558.120310:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914385024 00000100:00100000:0.0:1788612558.120335:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788612558.120344:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d853da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1875495914384768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788612558.120373:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1788612558.120412:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af4266c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.120434:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002fdd5b0c/0xfc956d548af4242e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb89 expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.120459:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788612558.120464:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612558.120469:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af4266c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.120497:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002fdd5b0c/0xfc956d548af4242e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb89 expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.120510:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002fdd5b0c/0xfc956d548af4242e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb89 expref: 12 pid: 6698 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612558.120524:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875495914385152:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612558.120584:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cda80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612558.120741:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788612558.120750:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875495914384896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788612558.120941:0:8463:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788612558.120945:0:8463:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788612558 00002000:00010000:2.0:1788612558.120947:0:8463:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788612558.120949:0:8463:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788612558 -> 1788612558 00002000:00010000:2.0:1788612558.120951:0:8463:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788612558.120997:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1875495914384896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 249us (1451us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788612558.121005:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788612558.121023:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788612558.121029:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875495914385024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788612558.121061:0:8463:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1788612558.121084:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c0fcd, atime: 0x6a9c0fcd, ctime: 0x6a9c0fcd, blocks: 0x1 00010000:00010000:2.0:1788612558.121090:0:8463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af42673 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.121099:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1788612558.121102:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612558.121108:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af42673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.121121:0:8463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af42673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.121131:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af42673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.121139:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af42673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.121157:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788612558.121670:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1875495914385024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 639us (2024us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788612558.121678:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1788612558.121707:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612558.121714:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af42673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.121735:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612558.121739:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af42673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.121749:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af42673 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.121766:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af42673 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.121774:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af42673 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.121796:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612558.121798:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612558.121800:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612558.125058:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:11611:x1875495893431808:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 54739us (55005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612558.125072:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 227 00000004:00080000:2.0:1788612558.128199:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff928d853d8700/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788612558.128214:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d853d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914385024:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788612558.128228:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff928d853d8380/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788612558.128233:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d853d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914384896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788612558.128548:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875495914385152:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612558.128575:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af4266c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612558.128640:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612558.129488:0:12375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893431936 00000100:00100000:3.0:1788612558.129498:0:12375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893431936 00000100:00100000:3.0:1788612558.129554:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:3.0:1788612558.129565:0:12375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:2353:x1875495893431936:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788612558.134494:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612558.134582:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893432064 00000100:00100000:3.0:1788612558.134594:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893432064 00010000:00010000:3.0:1788612558.134640:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002fdd5b0c/0xfc956d548af4242e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb89 expref: 14 pid: 6698 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612558.134692:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:3.0:1788612558.134703:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+14:2353:x1875495893432064:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612558.134734:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612558.134742:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002fdd5b0c/0xfc956d548af4242e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb89 expref: 14 pid: 6698 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.134755:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002fdd5b0c/0xfc956d548af4242e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb89 expref: 14 pid: 6698 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.134779:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fdd5b0c/0xfc956d548af4242e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb89 expref: 14 pid: 6698 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.134796:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612558.134801:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612558.134820:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af4266c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.134830:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af4266c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.135110:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612558.135166:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+13:2353:x1875495893432064:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 464us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612558.135174:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 85 00010000:00010000:3.0:1788612558.135272:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af4266c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.135283:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af4266c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.135301:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af4266c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.135308:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af4266c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.135326:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788612558.136710:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d853da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1875495914384768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16361us (17906us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788612558.136722:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1788612558.136751:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612558.136758:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af4266c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.136769:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdfc00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612558.136774:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af4266c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.136784:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af4266c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.136801:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af4266c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.137662:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047a089bc/0xfc956d548af4266c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.137700:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612558.137702:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612558.137704:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788612558.137751:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff928d853db800/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788612558.137760:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d853db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914384768:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788612558.238135:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:1.0:1788612558.238151:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1788612558.238157:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1788612558.238163:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:1.0:1788612558.238168:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1788612558.239992:0:12375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2353:x1875495893431936:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 110414us (111342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612558.240019:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:0.0:1788612558.254554:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612558.254666:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893432320 00000100:00100000:1.0:1788612558.254678:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893432320 00000100:00100000:1.0:1788612558.254746:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 228 00000100:00100000:1.0:1788612558.254758:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:11611:x1875495893432320:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788612558.254817:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612558.255088:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af42657 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc1c expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.255111:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff928e838ce700) 00010000:00010000:1.0:1788612558.255118:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612558.255216:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af4267a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.255232:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af4267a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.255261:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af4267a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788612558.255526:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027e2e909 reply state 000000009231bffa transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af4267a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612558.255535:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612558.255656:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:11611:x1875495893432320:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 899us (1113us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788612558.255664:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 228 00000100:00100000:1.0:1788612558.258832:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:3.0:1788612558.258972:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af4267a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.258985:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af4267a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.258993:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af4267a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.258998:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612558.259003:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af4267a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.259011:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af4267a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.259027:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff928e838ce700) 00010000:00010000:3.0:1788612558.259031:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612558.259035:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af4267a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.259042:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf000/0xfc956d548af4267a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612558.259167:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893432448 00000100:00100000:2.0:1788612558.259177:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893432448 00000100:00100000:2.0:1788612558.259230:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:2.0:1788612558.259240:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2354:x1875495893432448:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788612558.259433:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788612558.259437:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788612558 -> 1788612557 00002000:00010000:2.0:1788612558.259439:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788612557 00002000:00010000:2.0:1788612558.259442:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788612558 -> 1788612557 00002000:00010000:2.0:1788612558.259444:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788612558.259509:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2354:x1875495893432448:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 270us (686us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788612558.259515:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:2.0:1788612558.267923:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612558.268092:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893432704 00000100:00100000:0.0:1788612558.268102:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893432704 00000100:00100000:0.0:1788612558.268167:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 229 00000100:00100000:0.0:1788612558.268176:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:11611:x1875495893432704:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788612558.268239:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.268254:0:8316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4263b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc0e expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.268262:0:8316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.268293:0:8316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4263b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc0e expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.268306:0:8316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4263b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc0e expref: 20 pid: 5853 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612558.268337:0:8316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8316:1875495914385280:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612558.268425:0:8316:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788612558.271251:0:8316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8316:1875495914385280:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612558.271285:0:8316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612558.274892:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612558.275079:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893432832 00000100:00100000:0.0:1788612558.275088:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893432832 00010000:00010000:0.0:1788612558.275129:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4263b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc0e expref: 21 pid: 5853 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612558.275173:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:0.0:1788612558.275183:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:2355:x1875495893432832:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612558.275197:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612558.275203:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4263b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc0e expref: 21 pid: 5853 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.275217:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4263b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc0e expref: 21 pid: 5853 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.275238:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4263b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc0e expref: 21 pid: 5853 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.275254:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff928e838ce700) 00010000:00010000:0.0:1788612558.275260:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.275270:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.275293:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.275334:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612558.275391:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:2355:x1875495893432832:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 209us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612558.275398:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 86 00010000:00010000:1.0:1788612558.275506:0:8316:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.275525:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.275551:0:8316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.275558:0:8316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.275565:0:8316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.275571:0:8316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612558.275575:0:8316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.275583:0:8316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.275592:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff928e838ce700) 00010000:00010000:1.0:1788612558.275594:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788612558.275598:0:8316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.275603:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42681 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612558.275641:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:11611:x1875495893432704:12345-192.168.202.6@tcp:55:lhsmtool_posix.0 Request processed in 7466us (7728us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788612558.275661:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 229 00000100:00100000:0.0:1788612558.291111:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612558.291204:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893432960 00000100:00100000:1.0:1788612558.291216:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893432960 00000100:00100000:1.0:1788612558.291278:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:1.0:1788612558.291289:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2355:x1875495893432960:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788612558.291334:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ee005efe/0xfc956d548af42688 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.291355:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a47117c/0xfc956d548af42665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc2a expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.291364:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788612558.291368:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788612558.291372:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee005efe/0xfc956d548af42688 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.291407:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a47117c/0xfc956d548af42665 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc2a expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.291422:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a47117c/0xfc956d548af42665 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc2a expref: 8 pid: 6698 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612558.291437:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875495914385408:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612558.293064:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e922f9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612558.301100:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612558.301760:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893433088 00000100:00100000:3.0:1788612558.301787:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893433088 00010000:00010000:3.0:1788612558.301834:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a47117c/0xfc956d548af42665 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc2a expref: 9 pid: 6698 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612558.301920:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:3.0:1788612558.301931:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2355:x1875495893433088:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612558.301948:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612558.301972:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a47117c/0xfc956d548af42665 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc2a expref: 9 pid: 6698 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.301986:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a47117c/0xfc956d548af42665 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc2a expref: 9 pid: 6698 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.302012:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612558.302017:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788612558.302023:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee005efe/0xfc956d548af42688 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.302033:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee005efe/0xfc956d548af42688 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.302074:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612558.302149:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+9:2355:x1875495893433088:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 220us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612558.302156:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 87 00010000:00010000:1.0:1788612558.303256:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a47117c/0xfc956d548af42665 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc2a expref: 8 pid: 6698 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612558.303276:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875495914385408:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612558.303313:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee005efe/0xfc956d548af42688 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.303324:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee005efe/0xfc956d548af42688 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.303332:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee005efe/0xfc956d548af42688 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.303363:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ee005efe/0xfc956d548af42688 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.303372:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee005efe/0xfc956d548af42688 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.303379:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee005efe/0xfc956d548af42688 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.303386:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60e00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612558.303391:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee005efe/0xfc956d548af42688 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.303399:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee005efe/0xfc956d548af42688 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.303414:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee005efe/0xfc956d548af42688 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.303428:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee005efe/0xfc956d548af42688 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612558.303507:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2355:x1875495893432960:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 12220us (12410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612558.303517:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:0.0:1788612558.309109:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612558.309290:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893433344 00000100:00100000:2.0:1788612558.309301:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893433344 00000100:00100000:2.0:1788612558.309410:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 230 00000100:00100000:2.0:1788612558.309422:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:11611:x1875495893433344:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788612558.309508:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af4268f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.309541:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af4268f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.309552:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af4268f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.309799:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.309811:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42649 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc15 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.309820:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.310774:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42649 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc15 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.310795:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42649 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc15 expref: 20 pid: 5853 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612558.310809:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b87100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914385536:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612558.311004:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91fff480 going to sleep for 11 seconds 00000100:00100000:2.0:1788612558.315058:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612558.316125:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b87100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914385536:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612558.316164:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612558.318749:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893433472 00000100:00100000:1.0:1788612558.318767:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893433472 00010000:00010000:1.0:1788612558.318832:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42649 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc15 expref: 21 pid: 5853 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612558.318968:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:1.0:1788612558.318980:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e92346450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:2356:x1875495893433472:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612558.318995:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612558.319002:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42649 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc15 expref: 21 pid: 5853 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.319016:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42649 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc15 expref: 21 pid: 5853 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.319039:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60800/0xfc956d548af42649 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc15 expref: 21 pid: 5853 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.319068:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff928e838ce700) 00010000:00010000:1.0:1788612558.319074:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.319097:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.319104:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.319199:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612558.319275:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e92346450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:2356:x1875495893433472:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 296us (4237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612558.319283:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 88 00010000:00010000:0.0:1788612558.323557:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612558.323577:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612558.323996:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1788612558.324159:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788612558.324203:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1788612558.324294:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd59880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1875495914385664:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788612558.324366:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612558.324486:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612558.330087:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914385664 00000100:00100000:3.0:1788612558.330107:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914385664 00000100:00100000:0.0:1788612558.334600:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788612558.334614:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1875495914385664:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788612558.334786:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1875495914385664:12345-0@lo:1000:mdt00_000.0 Request processed in 173us (10418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612558.334797:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788612558.334911:0:5852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1788612558.334918:0:5852:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1788612558.334937:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff928d853d8380, transno 4294967321 00000100:00100000:3.0:1788612558.334955:0:5852:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff928d853db800 x1875495914384768/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788612574 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612558.334969:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd59880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1875495914385664:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788612558.335446:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788612558.335529:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0822680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1875495914385792:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788612558.335572:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612558.335596:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eadfc63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612558.336001:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914385792 00000100:00100000:2.0:1788612558.336010:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914385792 00000100:00100000:2.0:1788612558.336056:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612558.336065:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1875495914385792:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788612558.336259:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5852:x1875495914385792:12345-0@lo:1000:mdt00_000.0 Request processed in 195us (686us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788612558.336266:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788612558.336783:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0822680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1875495914385792:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788612558.336821:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.336831:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.336868:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.336873:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612558.336879:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.336895:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.336912:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff928e838ce700) 00010000:00010000:3.0:1788612558.336915:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612558.336928:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.336935:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12200/0xfc956d548af42696 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.336965:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af425d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.336971:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af425d9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.336976:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af425d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.336981:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612558.336984:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af425d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.336990:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af425d9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.336998:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612558.337000:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612558.337006:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af425e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf9 expref: 23 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.337016:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af425e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf9 expref: 23 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.337025:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af425e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf9 expref: 23 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.337098:0:5852:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af425e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf9 expref: 23 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612558.337110:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914385920:192.168.202.6@tcp:105: 00000100:00100000:3.0:1788612558.337175:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eadfc63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612558.353815:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612558.354165:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893433600 00000100:00100000:1.0:1788612558.354178:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893433600 00000100:00100000:1.0:1788612558.354230:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:1.0:1788612558.354239:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+24:11610:x1875495893433600:12345-192.168.202.6@tcp:49:lfs.0 00000100:00100000:1.0:1788612558.354388:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+24:11610:x1875495893433600:12345-192.168.202.6@tcp:49:lfs.0 Request processed in 141us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612558.354396:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:3.0:1788612558.361019:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875495914385920:192.168.202.6@tcp:105: 00010000:00010000:3.0:1788612558.361061:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af425d9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361072:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60600/0xfc956d548af425d9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361105:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4269d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361119:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4269d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361130:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4269d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361141:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4269d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361148:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4269d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361156:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4269d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361181:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612558.361186:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4269d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361194:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4269d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361207:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612558.361211:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612558.361215:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4269d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361220:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af4269d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361230:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af4268f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361236:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af4268f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361242:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af4268f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361247:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612558.361250:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af4268f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361255:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af4268f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361273:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612558.361276:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788612558.361280:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af4268f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.361286:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13c00/0xfc956d548af4268f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612558.361551:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612558.361746:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893433856 00000100:00100000:2.0:1788612558.361753:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893433856 00000100:00100000:2.0:1788612558.361885:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 231 00000100:00100000:2.0:1788612558.361896:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+24:11610:x1875495893433856:12345-192.168.202.6@tcp:58:lfs.0 00000100:00100000:3.0:1788612558.362810:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+24:11611:x1875495893433344:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 53387us (53709us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1788612558.362822:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 230 00000020:00080000:3.0:1788612558.362829:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788612558.363006:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788612558.363010:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612558.363542:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788612558.363554:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788612558.363834:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788612558.363966:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+23:11610:x1875495893433856:12345-192.168.202.6@tcp:58:lfs.0 Request processed in 2060us (2406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612558.363975:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 231 00000100:00100000:0.0:1788612558.373805:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612558.377271:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893434112 00000100:00100000:3.0:1788612558.377286:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893434112 00000100:00100000:3.0:1788612558.377386:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:3.0:1788612558.377396:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e8347b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+23:11611:x1875495893434112:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788612558.380364:0:12070:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788612558.380488:0:12070:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1788612558.384211:0:12070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.384238:0:12070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 12070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.384250:0:12070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.384259:0:12070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426a4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.384282:0:12070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426a4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.384289:0:12070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.384309:0:12070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612558.384548:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612558.384555:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.384561:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612558.384565:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.384573:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.384584:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff928ea7bbc500) 00010000:00010000:2.0:1788612558.384592:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788612558.384597:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426a4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.384602:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612558.384620:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612558.384621:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612558.384623:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612558.386230:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e8347b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+25:11611:x1875495893434112:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 8822us (12420us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788612558.386244:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000020:00080000:3.0:1788612558.386252:0:12070:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788612558.419387:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612558.419474:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893434240 00000100:00100000:3.0:1788612558.419484:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893434240 00000100:00100000:3.0:1788612558.419543:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 232 00000100:00100000:3.0:1788612558.419553:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+25:11613:x1875495893434240:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1788612558.419578:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612558.419598:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af426ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc31 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.419676:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af426b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.419692:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af426b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.419704:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af426b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.419722:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.419746:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.419754:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.420065:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af426c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.420077:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf2 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.420085:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af426c0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.420118:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf2 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.420134:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf2 expref: 26 pid: 5852 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612558.420148:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914386048:192.168.202.6@tcp:104: 00000100:00100000:3.0:1788612558.421475:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eadfc6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612558.435765:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612558.436319:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875495914386048:192.168.202.6@tcp:104: 00010000:00010000:3.0:1788612558.436348:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af426c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612558.436485:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893434496 00000100:00100000:0.0:1788612558.436493:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893434496 00000100:00100000:0.0:1788612558.436550:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:0.0:1788612558.436560:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+27:5593:x1875495893434496:12345-192.168.202.6@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788612558.436804:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+28:5593:x1875495893434496:12345-192.168.202.6@tcp:35:ldlm_bl.0 Request processed in 245us (1049us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788612558.436813:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:2.0:1788612558.438914:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612558.438996:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893434624 00000100:00100000:3.0:1788612558.439019:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893434624 00010000:00010000:3.0:1788612558.439065:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf2 expref: 28 pid: 5852 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612558.439098:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:3.0:1788612558.439107:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+28:2355:x1875495893434624:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612558.439121:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612558.439127:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf2 expref: 28 pid: 5852 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.439140:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf2 expref: 28 pid: 5852 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.439160:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12c00/0xfc956d548af425cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf2 expref: 28 pid: 5852 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.439177:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612558.439182:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af426c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.439191:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af426c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.439199:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af426c0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612558.439232:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612558.439285:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+27:2355:x1875495893434624:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 179us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612558.439302:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 89 00010000:00010000:1.0:1788612558.439365:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af426c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439373:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af426c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612558.439419:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788612558.439424:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788612558.439442:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af426c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439465:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af426c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439476:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af426b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439482:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af426b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439489:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af426b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439495:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612558.439498:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af426b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439505:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af426b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439513:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:1.0:1788612558.439516:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612558.439520:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af426b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439526:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af426b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439537:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439543:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439557:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439562:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612558.439564:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439570:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439579:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff928ea7bbc200) 00010000:00010000:1.0:1788612558.439581:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612558.439584:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439590:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030000/0xfc956d548af426b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439624:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af426ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc31 expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439639:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af426c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc31 expref: 26 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612558.439657:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:1.0:1788612558.439660:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612558.439662:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0077200, rc 0) 00000100:00100000:1.0:1788612558.439693:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+26:11613:x1875495893434240:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 20142us (20318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612558.439709:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 232 00010000:00010000:3.0:1788612558.444570:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788612558.972223:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1788612558.972242:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1788612558.972254:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000040:00080000:3.0:1788612559.408188:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612559.408199:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612559.408256:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788612559.408264:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788612559.408396:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec01f5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875495914386176:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788612559.408494:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea34bee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612559.413016:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec01f5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875495914386176:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788612559.420628:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612559.421511:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893434752 00000100:00100000:0.0:1788612559.421523:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893434752 00000100:00100000:0.0:1788612559.421595:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 233 00000100:00100000:0.0:1788612559.421607:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+26:11624:x1875495893434752:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788612559.421642:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788612559.421761:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+26:11624:x1875495893434752:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 155us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612559.421769:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 233 00000100:00100000:3.0:1788612559.426676:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612559.426720:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893435008 00000100:00100000:3.0:1788612559.426729:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893435008 00000100:00100000:3.0:1788612559.426784:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 234 00000100:00100000:3.0:1788612559.426794:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec01f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+26:11624:x1875495893435008:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612559.426825:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612559.426969:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af426c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc38 expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612559.427094:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789fc00/0xfc956d548af426ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612559.427110:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789fc00/0xfc956d548af426ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612559.427122:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789fc00/0xfc956d548af426ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612559.427143:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788612559.427497:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076000/0xfc956d548af426c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc38 expref: 29 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612559.427515:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789fc00/0xfc956d548af426ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc38 expref: 28 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612559.427525:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:3.0:1788612559.427528:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612559.427533:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928d8789fc00, rc 0) 00000100:00100000:3.0:1788612559.427599:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec01f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+28:11624:x1875495893435008:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 807us (946us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788612559.427606:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 234 00000100:00100000:2.0:1788612559.435293:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612559.435373:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612559.435432:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893435392 00000100:00100000:1.0:1788612559.435442:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893435392 00000100:00100000:1.0:1788612559.435511:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:1.0:1788612559.435521:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+28:2354:x1875495893435392:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612559.435538:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612559.435562:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789fc00/0xfc956d548af426ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc38 expref: 28 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612559.435579:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:1.0:1788612559.435585:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612559.435638:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+27:2354:x1875495893435392:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 118us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612559.435646:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:0.0:1788612559.435801:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893435264 00000100:00100000:0.0:1788612559.435806:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893435264 00000100:00100000:0.0:1788612559.436130:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 235 00000100:00100000:0.0:1788612559.436138:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+27:11624:x1875495893435264:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788612559.436226:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af426dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612559.436241:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af426dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612559.436252:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af426dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612559.436427:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af426dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612559.436435:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af426dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612559.436441:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af426dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612559.436447:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612559.436451:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af426dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612559.436459:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af426dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612559.436469:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:0.0:1788612559.436472:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788612559.436476:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af426dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612559.436482:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde200/0xfc956d548af426dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612559.436824:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+28:11624:x1875495893435264:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 684us (1540us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788612559.436859:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 235 00000040:00080000:2.0:1788612559.437231:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788612559.437236:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612559.437714:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788612559.437724:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788612559.450339:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612559.450377:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893435648 00000100:00100000:3.0:1788612559.450388:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893435648 00000100:00100000:3.0:1788612559.450452:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:3.0:1788612559.450462:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+28:11624:x1875495893435648:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788612559.450695:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+29:11624:x1875495893435648:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 234us (367us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788612559.450703:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000040:00080000:1.0:1788612559.458670:0:12570:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788612559.458683:0:12570:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612559.458732:0:12570:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788612559.458738:0:12570:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788612559.469088:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612559.698651:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612559.698737:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893435904 00000100:00100000:1.0:1788612559.698747:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893435904 00000100:00100000:1.0:1788612559.698808:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 236 00000100:00100000:1.0:1788612559.698819:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec082b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+29:11637:x1875495893435904:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612559.699448:0:8316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612559.699479:0:8316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af426e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc3f expref: -99 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612559.699593:0:8316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af426ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612559.699608:0:8316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af426ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612559.699621:0:8316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af426ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612559.699645:0:8316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788612559.700065:0:8316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd13200/0xfc956d548af426e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc3f expref: 32 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612559.700087:0:8316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af426ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc3f expref: 31 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612559.700097:0:8316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:2.0:1788612559.700100:0:8316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788612559.700104:0:8316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd12e00, rc 0) 00000100:00100000:2.0:1788612559.700264:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec082b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+31:11637:x1875495893435904:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1445us (1622us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788612559.700273:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 236 00000100:00100000:3.0:1788612559.709892:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612559.709959:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893436032 00000100:00100000:1.0:1788612559.709970:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893436032 00000100:00100000:1.0:1788612559.710029:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 237 00000100:00100000:1.0:1788612559.710039:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+31:11637:x1875495893436032:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:1.0:1788612559.710148:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af426f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612559.710184:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af426f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612559.710200:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af426f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612559.710236:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af426f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612559.710246:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af426f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612559.710254:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af426f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612559.710262:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612559.710268:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af426f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612559.710279:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af426f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612559.710293:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:1.0:1788612559.710297:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612559.710303:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af426f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612559.710312:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61a00/0xfc956d548af426f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612559.710416:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+31:11637:x1875495893436032:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 377us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612559.710423:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 237 00000100:00100000:2.0:1788612559.890162:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612559.890384:0:12375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893436160 00000100:00100000:3.0:1788612559.890396:0:12375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893436160 00000100:00100000:3.0:1788612559.890474:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:3.0:1788612559.890486:0:12375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2355:x1875495893436160:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:3.0:1788612559.890505:0:12375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612559.890530:0:12375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009be792ed/0xfc956d548af426ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc46 expref: -99 pid: 12375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612559.890557:0:12375:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9c0fcd, atime: 0x6a9c0fcd, ctime: 0x6a9c0fcd, blocks: 0xb 00010000:00010000:3.0:1788612559.890577:0:12375:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1788612559.890581:0:12375:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612559.890590:0:12375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009be792ed/0xfc956d548af426ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc46 expref: 8 pid: 12375 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612559.890607:0:12375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009be792ed/0xfc956d548af426ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc46 expref: 8 pid: 12375 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612559.890619:0:12375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928d8789fe00, rc 0) 00000100:00100000:3.0:1788612559.890694:0:12375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2355:x1875495893436160:12345-192.168.202.6@tcp:101:cat.0 Request processed in 209us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612559.890702:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:3.0:1788612559.893552:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612559.893879:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893436288 00000100:00100000:0.0:1788612559.893889:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893436288 00002000:00100000:0.0:1788612559.893938:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff928eb7fcf480 x1875495893436288/t0(0) o3->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:205/0 lens 488/0 e 0 to 0 dl 1788612570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788612559.893949:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928eb7fcf480 with x1875495893436288 ext(0->4095) 00002000:00010000:0.0:1788612559.893955:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928eb7fcf480 00000100:00100000:0.0:1788612559.893984:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:0.0:1788612559.893993:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2356:x1875495893436288:12345-192.168.202.6@tcp:3:cat.0 00000100:00100000:0.0:1788612559.894376:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2356:x1875495893436288:12345-192.168.202.6@tcp:3:cat.0 Request processed in 382us (831us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788612559.894385:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00002000:00100000:0.0:1788612559.894394:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff928eb7fcf480 x1875495893436288/t0(0) o3->f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab@192.168.202.6@tcp:205/0 lens 488/4536 e 0 to 0 dl 1788612570 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788612559.894403:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff928eb7fcf480 with x1875495893436288 ext(0->4095) 00002000:00010000:0.0:1788612559.894407:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff928eb7fcf480 00000100:00100000:1.0:1788612559.920878:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612559.920903:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914386304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612559.920980:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612559.921253:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914386304 00000100:00100000:3.0:1788612559.921263:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914386304 00000100:00100000:3.0:1788612559.921331:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788612559.921341:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec00bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914386304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612559.921375:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612559.921437:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec00bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914386304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612559.921458:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788612559.921812:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612559.923594:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788612559.923606:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff928ebfc34700, transno 4294967307 00000004:00080000:1.0:1788612559.923630:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788612559.923649:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff928d853d8700, transno 4294967310 00000100:00100000:1.0:1788612559.923676:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914386304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612560.430384:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914386432:0@lo:400:kworker.0 00000100:00100000:1.0:1788612560.430472:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612560.430525:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914386944:0@lo:400:kworker.0 00000100:00100000:1.0:1788612560.430551:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612560.430579:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612560.430586:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914386816:0@lo:400:kworker.0 00000100:00100000:1.0:1788612560.430610:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612560.430779:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914386432 00000100:00100000:2.0:1788612560.430788:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914386432 00000100:00100000:2.0:1788612560.430883:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788612560.430894:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3306:x1875495914386432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612560.430959:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22c69a0a-d366-4936-9310-01935a424f88+19:3306:x1875495914386432:12345-0@lo:400:kworker.0 Request processed in 67us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612560.430966:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788612560.431018:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914386432:0@lo:400:kworker.0 00000100:00100000:3.0:1788612560.431970:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914386560:0@lo:400:kworker.0 00000100:00100000:3.0:1788612560.432015:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612560.432049:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914387072:0@lo:400:kworker.0 00000100:00100000:3.0:1788612560.432109:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612560.432137:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612560.432143:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914386688:0@lo:400:kworker.0 00000100:00100000:3.0:1788612560.432162:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612560.432190:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914386944 00000100:00100000:3.0:1788612560.432195:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914386944 00000100:00100000:3.0:1788612560.432235:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914386560 00000100:00100000:3.0:1788612560.432237:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914386560 00000100:00100000:3.0:1788612560.432249:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914386688 00000100:00100000:3.0:1788612560.432251:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914386688 00000100:00100000:3.0:1788612560.432264:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788612560.432270:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914386944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612560.432311:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914386944:12345-0@lo:400:kworker.0 Request processed in 41us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612560.432317:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788612560.432330:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788612560.432336:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914386560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612560.432361:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914386560:12345-0@lo:400:kworker.0 Request processed in 26us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612560.432366:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788612560.432376:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788612560.432381:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914386688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612560.432436:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914386688:12345-0@lo:400:kworker.0 Request processed in 54us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612560.432442:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1788612560.432459:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612560.432484:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914386688:0@lo:400:kworker.0 00000100:00100000:3.0:1788612560.432495:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914386560:0@lo:400:kworker.0 00000100:00100000:3.0:1788612560.432524:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914386944:0@lo:400:kworker.0 00000100:00100000:1.0:1788612560.433240:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914386816 00000100:00100000:1.0:1788612560.433246:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914386816 00000100:00100000:1.0:1788612560.433284:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914387072 00000100:00100000:1.0:1788612560.433287:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914387072 00000100:00100000:1.0:1788612560.433307:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788612560.433313:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914386816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612560.433354:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914386816:12345-0@lo:400:kworker.0 Request processed in 41us (2743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612560.433367:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788612560.433378:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788612560.433383:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1875495914387072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612560.433428:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1875495914387072:12345-0@lo:400:kworker.0 Request processed in 44us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612560.433433:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788612560.434650:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612560.434693:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914387072:0@lo:400:kworker.0 00000100:00100000:3.0:1788612560.434730:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914386816:0@lo:400:kworker.0 00010000:00010000:0.0:1788612560.492391:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612560.830412:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612560.830515:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612560.830553:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612560.830577:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612560.830623:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612560.830680:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893436800 00000100:00100000:0.0:1788612560.830692:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893436800 00000100:00100000:0.0:1788612560.830751:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893436672 00000100:00100000:0.0:1788612560.830754:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893436672 00000100:00100000:0.0:1788612560.830776:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:0.0:1788612560.830785:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2355:x1875495893436800:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612560.830919:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+8:2355:x1875495893436800:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 134us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612560.830928:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:0.0:1788612560.831058:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:0.0:1788612560.831078:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893436672:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612560.831105:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893436672:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 40us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612560.831111:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00080000:0.0:1788612560.831130:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788612560.831134:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612560.832397:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893436416 00000100:00100000:2.0:1788612560.832408:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893436416 00000100:00100000:2.0:1788612560.832457:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 297 00000100:00100000:2.0:1788612560.832472:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893436416:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612560.832530:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893436416:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 59us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612560.832538:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 297 00000100:00100000:3.0:1788612560.840185:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893436544 00000100:00100000:3.0:1788612560.840201:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893436544 00000100:00100000:3.0:1788612560.840296:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893436928 00000100:00100000:3.0:1788612560.840300:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893436928 00000100:00100000:3.0:1788612560.840332:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 158 00000100:00100000:3.0:1788612560.840343:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+31:2355:x1875495893436544:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612560.840431:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+31:2355:x1875495893436544:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 89us (10027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612560.840438:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 158 00000100:00100000:3.0:1788612560.840458:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 159 00000100:00100000:3.0:1788612560.840466:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893436928:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612560.840491:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78d21d21-8748-4720-b30a-c0081165c376+5:2355:x1875495893436928:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 27us (9869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612560.840512:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 159 00000100:00080000:0.0:1788612560.841758:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612560.940198:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914387200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612560.940273:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612560.940521:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914387200 00000100:00100000:3.0:1788612560.940531:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914387200 00000100:00100000:3.0:1788612560.940590:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788612560.940600:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875495914387200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612560.940637:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612560.940696:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875495914387200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612560.940703:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788612560.940881:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914387200:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788612561.516436:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788612562.540363:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612562.540373:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612562.540403:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788612562.540410:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788612562.541054:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612563.566036:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788612563.606530:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1788612563.606548:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1788612563.653204:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:3.0:1788612563.653678:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1788612563.653699:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788612563.653724:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:2.0:1788612563.653739:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:3.0:1788612563.653822:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff928eadfc6540 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788612563.654066:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928d85b4eb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff928eadfc6600 00000020:00080000:3.0:1788612563.654069:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff928d85b4ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff928e9935a400 00000020:00080000:2.0:1788612563.654101:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788612563.654292:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1788612564.589111:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612565.037551:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612565.037582:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914387328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612565.037658:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612565.038497:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914387328 00000100:00100000:1.0:1788612565.038507:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914387328 00000100:00100000:1.0:1788612565.038572:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788612565.038583:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914387328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612565.038622:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788612565.038694:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914387328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612565.038701:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788612565.040176:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914387328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788612565.042034:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612565.374676:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612565.374783:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893437056 00000100:00100000:3.0:1788612565.374806:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893437056 00000100:00100000:3.0:1788612565.374909:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 238 00000100:00100000:3.0:1788612565.374921:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:11298:x1875495893437056:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788612565.375027:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:11298:x1875495893437056:12345-192.168.202.6@tcp:60:lhsmtool_posix.0 Request processed in 109us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612565.375034:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 238 00000100:00080000:0.0:1788612565.375144:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612565.389621:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612565.389760:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893437312 00000100:00100000:1.0:1788612565.389773:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893437312 00000100:00100000:1.0:1788612565.389880:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:1.0:1788612565.389892:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:11298:x1875495893437312:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788612565.390286:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:11298:x1875495893437312:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 395us (678us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788612565.390308:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:3.0:1788612565.549205:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914387712:0@lo:400:kworker.0 00000100:00100000:3.0:1788612565.549279:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612565.549345:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788612565.549352:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914387584:0@lo:400:kworker.0 00000100:00100000:3.0:1788612565.549373:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612565.549392:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914388096:0@lo:400:kworker.0 00000100:00100000:3.0:1788612565.549415:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612565.549444:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914387712 00000100:00100000:3.0:1788612565.549452:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914387712 00000100:00100000:3.0:1788612565.549508:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914387584 00000100:00100000:3.0:1788612565.549512:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914387584 00000100:00100000:3.0:1788612565.549540:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788612565.549551:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914387712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612565.549554:0:12375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914388096 00000100:00100000:1.0:1788612565.549561:0:12375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914388096 00000100:00100000:1.0:1788612565.549596:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788612565.549604:0:12375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914388096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612565.549656:0:12375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914388096:12345-0@lo:400:kworker.0 Request processed in 52us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612565.549665:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788612565.549682:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914387840:0@lo:400:kworker.0 00000100:00080000:1.0:1788612565.549690:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612565.549696:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612565.549731:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612565.549734:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788612565.549754:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914387584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612565.549770:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788612565.549779:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914387456:0@lo:400:kworker.0 00000100:00100000:1.0:1788612565.549791:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914387584:12345-0@lo:400:kworker.0 Request processed in 49us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612565.549798:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788612565.549815:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612565.549874:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914387840 00000100:00100000:1.0:1788612565.549878:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914387840 00000100:00100000:2.0:1788612565.549880:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914387968:0@lo:400:kworker.0 00000100:00100000:1.0:1788612565.549904:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788612565.549910:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612565.549916:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914387840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612565.549944:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914387456 00000100:00100000:2.0:1788612565.549949:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914387456 00000100:00100000:1.0:1788612565.549967:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914387840:12345-0@lo:400:kworker.0 Request processed in 52us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612565.549973:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788612565.549984:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788612565.549995:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914387456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612565.549995:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914387968 00000100:00100000:1.0:1788612565.550001:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914387968 00000100:00100000:1.0:1788612565.550028:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788612565.550036:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914387968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612565.550046:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914387456:12345-0@lo:400:kworker.0 Request processed in 53us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612565.550059:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788612565.550088:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914387968:12345-0@lo:400:kworker.0 Request processed in 52us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612565.550094:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788612565.550125:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914387456:0@lo:400:kworker.0 00000100:00080000:1.0:1788612565.550126:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612565.550154:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914387968:0@lo:400:kworker.0 00000100:00100000:1.0:1788612565.550158:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914387584:0@lo:400:kworker.0 00000100:00100000:2.0:1788612565.550174:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914387840:0@lo:400:kworker.0 00000100:00100000:1.0:1788612565.550175:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788612565.550182:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff928d853db800, transno 4294967322 00000004:00080000:1.0:1788612565.550192:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788612565.550208:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914388096:0@lo:400:kworker.0 00000100:00100000:3.0:1788612565.552090:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914387712:12345-0@lo:400:kworker.0 Request processed in 2531us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612565.552114:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788612565.552341:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914387712:0@lo:400:kworker.0 00010000:00010000:2.0:1788612565.612269:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612565.791035:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612565.791775:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893437440 00000100:00100000:1.0:1788612565.791788:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893437440 00000100:00100000:1.0:1788612565.791938:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 239 00000100:00080000:3.0:1788612565.792025:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612565.792115:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+5:12089:x1875495893437440:12345-192.168.202.6@tcp:101:lsof.0 00010000:00010000:1.0:1788612565.792140:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612565.792165:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af42706 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612565.792234:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4270d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612565.792249:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4270d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612565.792262:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4270d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612565.792386:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788612565.792391:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788612565.792417:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4270d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612565.792515:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60400/0xfc956d548af42706 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc4d expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612565.792534:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4270d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc4d expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612565.792544:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:1.0:1788612565.792547:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612565.792551:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60000, rc 0) 00000100:00100000:1.0:1788612565.792901:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+6:12089:x1875495893437440:12345-192.168.202.6@tcp:101:lsof.0 Request processed in 801us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612565.792909:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 239 00000100:00100000:2.0:1788612565.948595:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612565.948649:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612565.948687:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612565.948874:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893437568 00000100:00100000:3.0:1788612565.948886:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893437568 00000100:00100000:3.0:1788612565.948951:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 299 00000100:00100000:3.0:1788612565.948962:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2354:x1875495893437568:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612565.949050:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2354:x1875495893437568:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 89us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612565.949058:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 299 00000100:00100000:1.0:1788612565.951434:0:12375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893437696 00000100:00100000:1.0:1788612565.951449:0:12375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893437696 00000100:00100000:1.0:1788612565.951540:0:12375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893437824 00000100:00100000:1.0:1788612565.951545:0:12375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893437824 00000100:00080000:3.0:1788612565.951570:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612565.951574:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00080000:3.0:1788612565.951577:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612565.951586:0:12375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2354:x1875495893437696:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612565.951670:0:12375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2354:x1875495893437696:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 87us (3084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612565.951678:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:1.0:1788612565.951696:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:1.0:1788612565.951717:0:12375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2354:x1875495893437824:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612565.951747:0:12375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2354:x1875495893437824:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 32us (3060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612565.951753:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:0.0:1788612566.064160:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914388224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612566.064239:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612566.065186:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914388224 00000100:00100000:3.0:1788612566.065196:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914388224 00000100:00100000:3.0:1788612566.065263:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788612566.065274:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914388224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612566.065331:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612566.065497:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914388224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 215us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612566.065507:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788612566.079932:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914388224:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788612566.636314:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612567.660332:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612568.684493:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788612568.687403:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788612568.687436:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788612568.687497:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788612568.687509:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788612569.708099:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612570.156632:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914388352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612570.156707:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612570.157253:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914388352 00000100:00100000:3.0:1788612570.157263:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914388352 00000100:00100000:3.0:1788612570.157338:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788612570.157349:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914388352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612570.157383:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612570.157435:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914388352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612570.157442:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788612570.157489:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914388352:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788612570.157542:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788612570.644761:0:12776:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:49:29 (1788612569) 00000100:00100000:0.0:1788612570.682607:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914388480:0@lo:400:kworker.0 00000100:00100000:0.0:1788612570.682700:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612570.683415:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914388480 00000100:00100000:3.0:1788612570.683425:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914388480 00000100:00100000:3.0:1788612570.683589:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788612570.683601:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3306:x1875495914388480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612570.686532:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914388608:0@lo:400:kworker.0 00000100:00100000:1.0:1788612570.686607:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612570.686645:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612570.686652:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914388736:0@lo:400:kworker.0 00000100:00100000:1.0:1788612570.686676:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612570.686708:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914388864:0@lo:400:kworker.0 00000100:00100000:1.0:1788612570.686732:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612570.686764:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914388608 00000100:00100000:1.0:1788612570.686771:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914388608 00000100:00100000:1.0:1788612570.686811:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914388736 00000100:00100000:1.0:1788612570.686814:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914388736 00000100:00100000:1.0:1788612570.686872:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788612570.686881:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914388608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612570.686935:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914388608:12345-0@lo:400:kworker.0 Request processed in 55us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612570.686942:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788612570.686958:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788612570.686964:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914388736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612570.686988:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914388736:12345-0@lo:400:kworker.0 Request processed in 24us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612570.686994:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788612570.687050:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914388736:0@lo:400:kworker.0 00000100:00100000:1.0:1788612570.687060:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914388608:0@lo:400:kworker.0 00000100:00100000:1.0:1788612570.687096:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914388864 00000100:00100000:1.0:1788612570.687100:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914388864 00000100:00100000:1.0:1788612570.687124:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788612570.687387:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914388864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612570.687428:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914388864:12345-0@lo:400:kworker.0 Request processed in 298us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612570.687435:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788612570.687466:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914388864:0@lo:400:kworker.0 00000100:00100000:3.0:1788612570.691302:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3306:x1875495914388480:12345-0@lo:400:kworker.0 Request processed in 7691us (8590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612570.691323:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:2.0:1788612570.692923:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612570.692975:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612570.693179:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914388992:0@lo:400:kworker.0 00000100:00100000:2.0:1788612570.693244:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612570.693324:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914389120:0@lo:400:kworker.0 00000100:00100000:2.0:1788612570.693356:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612570.693607:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914388992 00000100:00100000:3.0:1788612570.693615:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914388992 00000100:00100000:3.0:1788612570.693675:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788612570.693683:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914388992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612570.693730:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914388992:12345-0@lo:400:kworker.0 Request processed in 48us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612570.693738:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:2.0:1788612570.694174:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612570.694211:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914388992:0@lo:400:kworker.0 00000100:00100000:0.0:1788612570.700049:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914388480:0@lo:400:kworker.0 00000100:00100000:1.0:1788612570.701420:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914389120 00000100:00100000:1.0:1788612570.701435:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914389120 00000100:00100000:1.0:1788612570.701520:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788612570.701533:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914389120:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788612570.701612:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612570.701645:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914389120:12345-0@lo:400:kworker.0 Request processed in 116us (8288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612570.701653:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788612570.701696:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914389120:0@lo:400:kworker.0 00010000:00010000:0.0:1788612570.735883:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612571.084621:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612571.084681:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612571.084724:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612571.084761:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893438464 00000100:00100000:1.0:1788612571.084770:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893438464 00000100:00100000:1.0:1788612571.084828:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 166 00000100:00100000:1.0:1788612571.084883:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+6:2355:x1875495893438464:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612571.084960:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78d21d21-8748-4720-b30a-c0081165c376+6:2355:x1875495893438464:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 122us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612571.084986:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 166 00000100:00100000:1.0:1788612571.085033:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612571.085162:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612571.085183:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893438080 00000100:00100000:1.0:1788612571.085187:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893438080 00000100:00100000:1.0:1788612571.085215:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 167 00000100:00100000:1.0:1788612571.085222:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:2355:x1875495893438080:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612571.085269:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:2355:x1875495893438080:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 47us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612571.085276:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 167 00000100:00100000:1.0:1788612571.085295:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893438208 00000100:00100000:1.0:1788612571.085298:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893438208 00000100:00100000:1.0:1788612571.085322:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893438336 00000100:00100000:1.0:1788612571.085325:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893438336 00000100:00100000:1.0:1788612571.085345:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:1.0:1788612571.085351:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893438208:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612571.085379:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2355:x1875495893438208:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 29us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612571.085386:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:1.0:1788612571.085397:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:1.0:1788612571.085403:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2355:x1875495893438336:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612571.085426:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2355:x1875495893438336:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612571.085432:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:2.0:1788612571.088229:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893437952 00000100:00100000:2.0:1788612571.088251:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893437952 00000100:00100000:2.0:1788612571.088322:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 301 00000100:00100000:2.0:1788612571.088333:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893437952:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612571.088417:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2355:x1875495893437952:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 86us (3815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612571.088425:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 301 00000100:00080000:2.0:1788612571.088460:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612571.088464:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612571.088467:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612571.180049:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d87ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914389248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612571.180350:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612571.180383:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914389248 00000100:00100000:2.0:1788612571.180392:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914389248 00000100:00100000:2.0:1788612571.180477:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788612571.180498:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914389248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612571.180533:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612571.180594:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914389248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612571.180601:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788612571.180682:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d87ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914389248:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788612571.760944:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788612572.780058:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788612572.780067:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612572.780535:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788612572.780542:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788612572.781700:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612573.804025:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612574.836666:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612575.276156:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914389376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612575.276259:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612575.276834:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914389376 00000100:00100000:0.0:1788612575.276861:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914389376 00000100:00100000:0.0:1788612575.276950:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788612575.276969:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914389376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788612575.277008:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612575.277074:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914389376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612575.277082:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788612575.277154:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914389376:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788612575.277230:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612575.644023:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612575.644176:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893438720 00000100:00100000:3.0:1788612575.644198:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893438720 00000100:00100000:3.0:1788612575.644343:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:3.0:1788612575.644358:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+18:12310:x1875495893438720:12345-192.168.202.6@tcp:35:umount.0 00000100:00080000:2.0:1788612575.644589:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612575.645211:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:12310:x1875495893438720:12345-192.168.202.6@tcp:35:umount.0 Request processed in 853us (1194us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788612575.645228:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:0.0:1788612575.657689:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612575.662080:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893438976 00000100:00100000:3.0:1788612575.662097:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893438976 00000100:00100000:3.0:1788612575.662186:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:3.0:1788612575.662198:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+19:12310:x1875495893438976:12345-192.168.202.6@tcp:35:umount.0 00000100:00100000:3.0:1788612575.662558:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:12310:x1875495893438976:12345-192.168.202.6@tcp:35:umount.0 Request processed in 361us (4878us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788612575.662566:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:1.0:1788612575.665613:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612575.665733:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893439232 00000100:00100000:3.0:1788612575.665744:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893439232 00000100:00100000:3.0:1788612575.665810:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:3.0:1788612575.665819:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e8347a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+20:12310:x1875495893439232:12345-192.168.202.6@tcp:35:umount.0 00000100:00100000:3.0:1788612575.666111:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e8347a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:12310:x1875495893439232:12345-192.168.202.6@tcp:35:umount.0 Request processed in 292us (506us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788612575.666120:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:1.0:1788612575.669974:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612575.670084:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893439488 00000100:00100000:0.0:1788612575.670097:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893439488 00000100:00100000:0.0:1788612575.670153:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1788612575.670163:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+21:12310:x1875495893439488:12345-192.168.202.6@tcp:35:umount.0 00000100:00100000:0.0:1788612575.670560:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+22:12310:x1875495893439488:12345-192.168.202.6@tcp:35:umount.0 Request processed in 396us (597us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788612575.670568:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:1.0:1788612575.681307:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612575.681482:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893439616 00000100:00100000:0.0:1788612575.681493:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893439616 00000100:00100000:0.0:1788612575.681560:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:0.0:1788612575.681569:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2354:x1875495893439616:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612575.681584:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612575.681610:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e8000/0xfc956d548af41723 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7d8 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.681649:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612575.681702:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93581484-5c48-42e2-a9bb-7e5e07222f81+12:2354:x1875495893439616:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 133us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612575.681710:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:1.0:1788612575.683573:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612575.683720:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612575.687813:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612575.688460:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893440256 00000100:00100000:0.0:1788612575.688472:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893440256 00000100:00100000:0.0:1788612575.688567:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:0.0:1788612575.688579:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2352:x1875495893440256:12345-192.168.202.6@tcp:9:umount.0 00000020:00000080:0.0:1788612575.688611:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af41cc5 00000020:00010000:0.0:1788612575.688619:0:6698:0:(genops.c:1921:obd_stale_export_put()) Put export ffff928d853b6000: total 0 00000100:00080000:0.0:1788612575.688623:0:6698:0:(import.c:65:import_set_state_nolock()) ffff928d853b4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788612575.688667:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788612575.688938:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2352:x1875495893440256:12345-192.168.202.6@tcp:9:umount.0 Request processed in 360us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612575.688946:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00000020:00010000:0.0:1788612575.688969:0:5840:0:(genops.c:1907:obd_stale_export_get()) Get export ffff928d853b6000: total 0 00010000:00010000:0.0:1788612575.688988:0:5840:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff928d853b6000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788612575.689042:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df5b8eec/0xfc956d548af42061 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda78 expref: 4 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.689082:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009be792ed/0xfc956d548af426ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc46 expref: 3 pid: 12375 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.689099:0:5840:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff928d853b6000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788612575.689110:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612575.689127:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612575.689128:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788612575.690742:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612575.692316:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893439872 00000100:00100000:2.0:1788612575.692482:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893439872 00000100:00100000:2.0:1788612575.692656:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893439744 00000100:00100000:2.0:1788612575.692660:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893439744 00000100:00100000:0.0:1788612575.692702:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:0.0:1788612575.692713:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93581484-5c48-42e2-a9bb-7e5e07222f81+13:2354:x1875495893439872:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612575.692729:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612575.692748:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e8800/0xfc956d548af41999 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8a3 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.692768:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612575.692868:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93581484-5c48-42e2-a9bb-7e5e07222f81+12:2354:x1875495893439872:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 157us (11526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612575.692876:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:0.0:1788612575.692895:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:0.0:1788612575.692902:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93581484-5c48-42e2-a9bb-7e5e07222f81+11:2354:x1875495893439744:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612575.692909:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612575.692919:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e910d6600/0xfc956d548af416eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7a0 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.692927:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612575.692945:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2354:x1875495893439744:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 44us (9225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612575.692950:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:1.0:1788612575.697983:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612575.698589:0:12375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893440384 00000100:00100000:2.0:1788612575.698604:0:12375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893440384 00000100:00100000:2.0:1788612575.698711:0:12375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:2.0:1788612575.698723:0:12375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+5:2352:x1875495893440384:12345-192.168.202.6@tcp:9:umount.0 00000020:00000080:2.0:1788612575.698754:0:12375:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af41a5d 00000100:00080000:2.0:1788612575.698761:0:12375:0:(import.c:65:import_set_state_nolock()) ffff928d8507f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788612575.699075:0:12375:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788612575.699398:0:12375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+2:2352:x1875495893440384:12345-192.168.202.6@tcp:9:umount.0 Request processed in 675us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612575.699407:0:12375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00080000:1.0:1788612575.700090:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788612575.701305:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612575.719828:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612575.720124:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893441408 00000100:00100000:2.0:1788612575.720136:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893441408 00000100:00100000:2.0:1788612575.720206:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 240 00000100:00100000:2.0:1788612575.720217:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+22:2352:x1875495893441408:12345-192.168.202.6@tcp:39:umount.0 00000020:00000080:2.0:1788612575.720253:0:5854:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af416f9 00000020:00010000:2.0:1788612575.720272:0:5854:0:(genops.c:1921:obd_stale_export_put()) Put export ffff928d8529e000: total 0 00000100:00080000:2.0:1788612575.720278:0:5854:0:(import.c:65:import_set_state_nolock()) ffff928d85298000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788612575.720307:0:5854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1788612575.720453:0:5840:0:(genops.c:1907:obd_stale_export_get()) Get export ffff928d8529e000: total 0 00010000:00010000:0.0:1788612575.720457:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612575.720494:0:5840:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff928d8529e000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788612575.720534:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:0.0:1788612575.720549:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788612575.720558:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af41d20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd99f expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.720578:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff928ea7bbcc00) 00010000:00010000:0.0:1788612575.720581:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612575.720585:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077000/0xfc956d548af419c3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8b1 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.720603:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:0.0:1788612575.720605:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788612575.720609:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af423be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddb6d expref: 19 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.720620:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff928ea7bbcf00) 00010000:00010000:0.0:1788612575.720623:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788612575.720626:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077600/0xfc956d548af41a33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8cd expref: 18 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.720638:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:0.0:1788612575.720640:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788612575.720644:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077400/0xfc956d548af425e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddbf9 expref: 17 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.720653:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff928e838ce600) 00010000:00010000:0.0:1788612575.720655:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788612575.720658:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61400/0xfc956d548af420df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda9b expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.720684:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:0.0:1788612575.720687:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788612575.720690:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077a00/0xfc956d548af41f42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda2b expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.720703:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb600) 00010000:00010000:0.0:1788612575.720705:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612575.720708:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af419df lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd8b8 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.720723:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:0.0:1788612575.720725:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788612575.720728:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928eacd12e00/0xfc956d548af426ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc3f expref: 13 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.720738:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:0.0:1788612575.720740:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612575.720743:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8200/0xfc956d548af42022 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda63 expref: 12 pid: 8316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.720754:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff928e9231d300) 00010000:00010000:0.0:1788612575.720757:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788612575.720760:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0076800/0xfc956d548af4204c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda71 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.720777:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff928ea7bbc700) 00010000:00010000:0.0:1788612575.720790:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612575.720801:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0077200/0xfc956d548af426c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc31 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.720818:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:0.0:1788612575.720820:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612575.720824:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9e00/0xfc956d548af420c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dda94 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612575.720834:0:5840:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff928d8529e000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788612575.720886:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612575.720887:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612575.720889:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612575.724496:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab+7:2352:x1875495893441408:12345-192.168.202.6@tcp:39:umount.0 Request processed in 4263us (4661us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788612575.724512:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 240 00000100:00100000:3.0:1788612575.791777:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914389888:0@lo:400:kworker.0 00000100:00100000:0.0:1788612575.791777:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914389632:0@lo:400:kworker.0 00000100:00100000:1.0:1788612575.791856:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914389760:0@lo:400:kworker.0 00000100:00100000:2.0:1788612575.801022:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612575.802968:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788612575.803004:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914389504:0@lo:400:kworker.0 00000100:00100000:2.0:1788612575.803231:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612575.803276:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914390016:0@lo:400:kworker.0 00000100:00100000:2.0:1788612575.803307:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612575.803493:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914389888 00000100:00100000:3.0:1788612575.803503:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914389888 00000100:00100000:3.0:1788612575.803581:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788612575.803591:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d87ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914389888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612575.803652:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d87ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914389888:12345-0@lo:400:kworker.0 Request processed in 62us (2647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612575.803660:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788612575.803684:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914389504 00000100:00100000:3.0:1788612575.803687:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914389504 00000100:00100000:3.0:1788612575.803711:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788612575.803717:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914389504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612575.803764:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914389504:12345-0@lo:400:kworker.0 Request processed in 47us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612575.803771:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788612575.803814:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914390016 00000100:00100000:3.0:1788612575.803817:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914390016 00000100:00100000:3.0:1788612575.803874:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788612575.803881:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914390016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612575.803913:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914390016:12345-0@lo:400:kworker.0 Request processed in 33us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612575.803918:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1788612575.808248:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612575.808263:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612575.808344:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914389504:0@lo:400:kworker.0 00000100:00100000:2.0:1788612575.808367:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914390016:0@lo:400:kworker.0 00000100:00100000:2.0:1788612575.808382:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914389888:0@lo:400:kworker.0 00000100:00100000:1.0:1788612575.813603:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612575.813804:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612575.814481:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914389760 00000100:00100000:2.0:1788612575.814494:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914389760 00000100:00100000:2.0:1788612575.814574:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914389632 00000100:00100000:2.0:1788612575.814578:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914389632 00000100:00100000:2.0:1788612575.814600:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788612575.814608:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914389760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612575.814674:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914389760:12345-0@lo:400:kworker.0 Request processed in 67us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612575.814681:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788612575.814698:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788612575.814704:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914389632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612575.814733:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914389632:12345-0@lo:400:kworker.0 Request processed in 29us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612575.814739:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788612575.815035:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914389632:0@lo:400:kworker.0 00000100:00100000:2.0:1788612575.815489:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914389760:0@lo:400:kworker.0 00000100:00080000:3.0:1788612575.815573:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788612575.852678:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612576.187484:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612576.187546:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612576.187582:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893441536 00000100:00100000:0.0:1788612576.187595:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893441536 00000100:00100000:2.0:1788612576.187722:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893441664 00000100:00100000:2.0:1788612576.187727:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893441664 00000100:00100000:2.0:1788612576.187789:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 171 00000100:00100000:2.0:1788612576.187800:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+6:2353:x1875495893441664:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:1.0:1788612576.187828:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612576.187907:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78d21d21-8748-4720-b30a-c0081165c376+6:2353:x1875495893441664:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 109us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612576.187914:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 171 00000100:00100000:1.0:1788612576.188173:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 303 00000100:00100000:1.0:1788612576.188192:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2353:x1875495893441536:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612576.188235:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2353:x1875495893441536:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 54us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612576.188242:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 303 00000100:00100000:3.0:1788612576.300347:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612576.300373:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914390144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612576.300461:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612576.300629:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914390144 00000100:00100000:2.0:1788612576.300637:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914390144 00000100:00100000:2.0:1788612576.300695:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788612576.300706:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914390144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612576.300740:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612576.300801:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914390144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612576.300809:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788612576.300886:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914390144:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788612576.876459:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612577.723783:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612577.723879:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612577.723901:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612577.724124:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612577.724156:0:8316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893442304 00000100:00100000:3.0:1788612577.724166:0:8316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893442304 00000100:00100000:3.0:1788612577.724230:0:8316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 241 00000100:00100000:3.0:1788612577.724240:0:8316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+6:2352:x1875495893442304:12345-192.168.202.6@tcp:39:umount.0 00000020:00000080:3.0:1788612577.724280:0:8316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af417e0 00000020:00010000:3.0:1788612577.724289:0:8316:0:(genops.c:1921:obd_stale_export_put()) Put export ffff928e90c61800: total 0 00000100:00080000:3.0:1788612577.724294:0:8316:0:(import.c:65:import_set_state_nolock()) ffff928e90c65800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788612577.724332:0:8316:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788612577.724547:0:8316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78d21d21-8748-4720-b30a-c0081165c376+5:2352:x1875495893442304:12345-192.168.202.6@tcp:39:umount.0 Request processed in 307us (421us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788612577.724555:0:8316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 241 00000100:00100000:2.0:1788612577.725147:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893441920 00000100:00100000:2.0:1788612577.725154:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893441920 00000100:00100000:2.0:1788612577.725207:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893441792 00000100:00100000:2.0:1788612577.725211:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893441792 00000100:00100000:2.0:1788612577.725225:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893442048 00000100:00100000:2.0:1788612577.725228:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893442048 00000100:00100000:2.0:1788612577.725244:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:2.0:1788612577.725250:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93581484-5c48-42e2-a9bb-7e5e07222f81+12:2355:x1875495893441920:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612577.725262:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612577.725280:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e910d6400/0xfc956d548af417d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd817 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612577.725294:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612577.725320:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93581484-5c48-42e2-a9bb-7e5e07222f81+11:2355:x1875495893441920:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 71us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612577.725328:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:2.0:1788612577.725343:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:2.0:1788612577.725348:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e92345850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93581484-5c48-42e2-a9bb-7e5e07222f81+10:2355:x1875495893441792:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612577.725368:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612577.725378:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e910d6e00/0xfc956d548af417cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7ed expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612577.725387:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612577.725406:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e92345850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93581484-5c48-42e2-a9bb-7e5e07222f81+9:2355:x1875495893441792:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 57us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612577.725412:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:2.0:1788612577.725457:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:2.0:1788612577.725463:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93581484-5c48-42e2-a9bb-7e5e07222f81+8:2355:x1875495893442048:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612577.725471:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612577.725480:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b61e00/0xfc956d548af41992 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd89c expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612577.725489:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612577.725504:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93581484-5c48-42e2-a9bb-7e5e07222f81+7:2355:x1875495893442048:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 41us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612577.725510:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000020:00010000:2.0:1788612577.727233:0:5841:0:(genops.c:1907:obd_stale_export_get()) Get export ffff928e90c61800: total 0 00010000:00010000:2.0:1788612577.727283:0:5841:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff928e90c61800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788612577.727316:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d900) 00010000:00010000:2.0:1788612577.727320:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612577.727330:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b60000/0xfc956d548af4270d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc4d expref: 4 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612577.727359:0:5841:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff928e90c61800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788612577.727370:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612577.727385:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612577.727387:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612577.750311:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612577.750397:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893442560 00000100:00100000:3.0:1788612577.750408:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893442560 00000100:00100000:3.0:1788612577.750472:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 304 00000100:00100000:3.0:1788612577.750483:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e915bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+7:2352:x1875495893442560:12345-192.168.202.6@tcp:251:umount.0 00000020:00000080:3.0:1788612577.750532:0:5844:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af416d6 00000020:00010000:3.0:1788612577.750541:0:5844:0:(genops.c:1921:obd_stale_export_put()) Put export ffff928eacf4d800: total 0 00000100:00080000:3.0:1788612577.750546:0:5844:0:(import.c:65:import_set_state_nolock()) ffff928eacf48000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788612577.750627:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e915bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93581484-5c48-42e2-a9bb-7e5e07222f81+3:2352:x1875495893442560:12345-192.168.202.6@tcp:251:umount.0 Request processed in 145us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612577.750635:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 304 00000020:00010000:2.0:1788612577.750758:0:5840:0:(genops.c:1907:obd_stale_export_get()) Get export ffff928eacf4d800: total 0 00010000:00010000:2.0:1788612577.750763:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612577.750813:0:5840:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff928eacf4d800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788612577.750885:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b60a00/0xfc956d548af4172a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dd7df expref: 2 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612577.750899:0:5840:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff928eacf4d800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788612577.750910:0:5840:0:(genops.c:885:class_export_put()) final put ffff928eacf4d800/93581484-5c48-42e2-a9bb-7e5e07222f81 00010000:00010000:2.0:1788612577.750919:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612577.750921:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612577.750923:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788612577.751454:0:497:0:(genops.c:844:class_export_destroy()) destroying export ffff928eacf4d800/93581484-5c48-42e2-a9bb-7e5e07222f81 for MGS 00000020:00000080:3.0:1788612577.751497:0:497:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928eacf48000 for MGS 00010000:00010000:2.0:1788612577.900712:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612578.924148:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788612578.966818:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1788612578.966835:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000001:00080000:1.0:1788612578.966856:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1788612578.966869:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 78d21d21-8748-4720-b30a-c0081165c376 00000001:00080000:1.0:1788612578.966875:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788612578.966877:0:5874:0:(genops.c:885:class_export_put()) final put ffff928e90c61800/78d21d21-8748-4720-b30a-c0081165c376 00000020:00000080:3.0:1788612578.966894:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff928e90c61800/78d21d21-8748-4720-b30a-c0081165c376 for lustre-MDT0000 00000020:00000080:1.0:1788612578.966894:0:5874:0:(genops.c:885:class_export_put()) final put ffff928d8529e000/f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000020:00000080:3.0:1788612578.978002:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff928d8529e000/f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab for lustre-MDT0000 00000020:00000080:3.0:1788612578.978181:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928e90c65800 for lustre-MDT0000 00000020:00000080:3.0:1788612578.978187:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928d85298000 for lustre-MDT0000 00000001:00100000:0.0:1788612578.978691:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000020:00000080:0.0:1788612578.978697:0:7644:0:(genops.c:885:class_export_put()) final put ffff928d853b6000/f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000020:00000080:0.0:1788612578.978713:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928d853b6000/f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab for lustre-OST0001 00000020:00000080:0.0:1788612578.978739:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928d853b4800 for lustre-OST0001 00000001:00100000:2.0:1788612579.463858:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000020:00000080:2.0:1788612579.463868:0:6721:0:(genops.c:885:class_export_put()) final put ffff928d8524f800/f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab 00000020:00000080:3.0:1788612579.463903:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff928d8524f800/f7d9e00c-38d3-4b9b-8cb8-dfe35d117dab for lustre-OST0000 00000020:00000080:3.0:1788612579.463960:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928d8507f800 for lustre-OST0000 00000020:01000004:1.0:1788612579.712798:0:12976:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788612579.723307:0:12976:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788612579.723369:0:12976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612579.723385:0:12976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612579.723396:0:12976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612579.723404:0:12976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612579.723435:0:12976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788612579.723440:0:12976:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788612579.723464:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788612579.723469:0:12976:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788612579.723475:0:12976:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788612579.723500:0:12976:0:(import.c:65:import_set_state_nolock()) ffff928eacc7d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788612579.723514:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612579.723523:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.723532:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7400 already unused, calling callback (ffffffffc1a10c20) 00000100:00100000:1.0:1788612579.723538:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec034c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875495914390272:0@lo:39:umount.0 10000000:00010000:0.0:1788612579.723546:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.723557:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612579.723565:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612579.723572:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788612579.723575:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788612579.723578:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788612579.723604:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612579.723613:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612579.723616:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612579.723645:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.723653:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d7400/0xfc956d548af41769 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af41770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.723665:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612579.723667:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612579.723670:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612579.723688:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914390272 00000100:00100000:1.0:1788612579.723695:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914390272 00000100:00100000:1.0:1788612579.723736:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788612579.723742:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612579.723745:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875495914390272:12345-0@lo:39:umount.0 00000100:00100000:0.0:1788612579.723756:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914390400:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788612579.723780:0:5853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af414f3 00000100:00080000:1.0:1788612579.723790:0:5853:0:(import.c:65:import_set_state_nolock()) ffff928e91629800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788612579.723795:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612579.723891:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1875495914390272:12345-0@lo:39:umount.0 Request processed in 146us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612579.723898:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:0.0:1788612579.723908:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928eacc7d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:1.0:1788612579.723909:0:5853:0:(genops.c:885:class_export_put()) final put ffff928e9162f800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1788612579.723923:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec034c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875495914390272:0@lo:39:umount.0 00000020:00000080:1.0:1788612579.723939:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff928e9162f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1788612579.723956:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612579.723960:0:12976:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788612579.723964:0:12976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788612579.723984:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928e91629800 for lustre-MDT0000 00010000:00010000:2.0:1788612579.724105:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612579.724115:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914390400 00000100:00100000:2.0:1788612579.724119:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914390400 00000100:00100000:2.0:1788612579.724535:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788612579.724544:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22c69a0a-d366-4936-9310-01935a424f88+19:3307:x1875495914390400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612579.724555:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612579.724569:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea0145a00/0xfc956d548af41770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af41769 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.724581:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612579.724616:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22c69a0a-d366-4936-9310-01935a424f88+18:3307:x1875495914390400:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612579.724622:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788612579.724661:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914390400:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612579.725810:0:12976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.725824:0:12976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.725832:0:12976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.725910:0:12976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.725965:0:12976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612579.725971:0:12976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.725978:0:12976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.725985:0:12976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.725992:0:12976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.726047:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788612579.726055:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.726062:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9600 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612579.726067:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.726076:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612579.726082:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612579.726087:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788612579.726090:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788612579.726114:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.726120:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612579.726153:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.726161:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928ec21e9600/0xfc956d548af41777 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af4177e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.726173:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612579.726176:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.726201:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61600 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612579.726203:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.726220:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612579.726226:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612579.726231:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788612579.726233:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788612579.726246:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.726251:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612579.726257:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.726263:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612579.726265:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612579.726267:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612579.726283:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914390528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612579.726332:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612579.726371:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612579.726377:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914390656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612579.726399:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612579.726440:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914390528 00000100:00100000:2.0:1788612579.726452:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914390528 00000100:00100000:2.0:1788612579.726488:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914390656 00000100:00100000:2.0:1788612579.726491:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914390656 00000100:00100000:2.0:1788612579.726514:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612579.726522:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22c69a0a-d366-4936-9310-01935a424f88+19:3305:x1875495914390528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612579.726532:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612579.726544:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e80031800/0xfc956d548af4177e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af41777 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.726557:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612579.726588:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22c69a0a-d366-4936-9310-01935a424f88+18:3305:x1875495914390528:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612579.726595:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612579.726611:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788612579.726617:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22c69a0a-d366-4936-9310-01935a424f88+17:3305:x1875495914390656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612579.726626:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612579.726635:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b61000/0xfc956d548af41697 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af41690 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.726647:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612579.726666:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22c69a0a-d366-4936-9310-01935a424f88+16:3305:x1875495914390656:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612579.726673:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788612579.726724:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914390656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612579.726733:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22c69a0a-d366-4936-9310-01935a424f88:3305:1875495914390528:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612579.727033:0:12976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788612579.727039:0:12976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af41690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af41697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612579.727059:0:12976:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788612579.727066:0:12976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.727073:0:12976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.727080:0:12976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.727085:0:12976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.727108:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612579.727113:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.727178:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0076e00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612579.727183:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.727191:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612579.727197:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612579.727202:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788612579.727205:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788612579.727228:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.727235:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612579.727251:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.727258:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612579.727259:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612579.727261:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612579.727267:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612579.727276:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914390784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612579.727303:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612579.727329:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914390784 00000100:00100000:2.0:1788612579.727333:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914390784 00000100:00100000:2.0:1788612579.727356:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788612579.727362:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22c69a0a-d366-4936-9310-01935a424f88+16:3308:x1875495914390784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612579.727376:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612579.727384:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea0077c00/0xfc956d548af4198b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af41984 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.727394:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612579.727420:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22c69a0a-d366-4936-9310-01935a424f88+15:3308:x1875495914390784:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612579.727427:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788612579.727519:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914390784:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612579.727584:0:12976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788612579.727589:0:12976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928ea0076e00/0xfc956d548af41984 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af4198b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612579.727599:0:12976:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788612579.727605:0:12976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e80030a00/0xfc956d548af41444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.727611:0:12976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e80030a00/0xfc956d548af41444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.727617:0:12976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e80030a00/0xfc956d548af41444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.727623:0:12976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff928e80030a00/0xfc956d548af41444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.727655:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612579.727660:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e80030a00/0xfc956d548af41444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.727667:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030a00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612579.727670:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e80030a00/0xfc956d548af41444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.727735:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e80030a00/0xfc956d548af41444 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612579.727743:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e80030a00/0xfc956d548af41444 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612579.727749:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788612579.727751:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1788612579.727765:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e80030a00/0xfc956d548af41444 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.727770:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612579.727787:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e80030a00/0xfc956d548af41444 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.727795:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612579.727796:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612579.727798:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612579.727807:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914390912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612579.727831:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612579.727875:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914390912 00000100:00100000:2.0:1788612579.727879:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914390912 00000100:00100000:2.0:1788612579.727904:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788612579.727910:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22c69a0a-d366-4936-9310-01935a424f88+15:3308:x1875495914390912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612579.727917:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612579.727926:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea0144a00/0xfc956d548af4144b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af41444 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612579.727939:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612579.727964:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22c69a0a-d366-4936-9310-01935a424f88+14:3308:x1875495914390912:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612579.727971:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788612579.727998:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22c69a0a-d366-4936-9310-01935a424f88:3308:1875495914390912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612579.728077:0:12976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788612579.728081:0:12976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e80030a00/0xfc956d548af41444 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af4144b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612579.728091:0:12976:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1788612579.728095:0:12976:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788612579.728097:0:12976:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788612579.728124:0:12976:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00010000:00010000:2.0:1788612579.728198:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788612579.728223:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788612579.728230:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612579.728236:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788612579.728241:0:12976:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff928d8524d800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788612579.728247:0:12976:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff928d85250800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788612579.728252:0:12976:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff928e86f04d40) has exports, disconnecting them 00000020:00080000:0.0:1788612579.728256:0:12976:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff928d8524d800), last request at 1788612575 00000020:00000080:0.0:1788612579.728263:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af41658 00000100:00080000:0.0:1788612579.728280:0:12976:0:(import.c:65:import_set_state_nolock()) ffff928d8524c800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788612579.728378:0:12976:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff928d8524d800): rc 0 00000020:00000080:0.0:1788612579.728381:0:12976:0:(genops.c:885:class_export_put()) final put ffff928d8524d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788612579.728390:0:12976:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff928d85250800), last request at 1788612575 00000020:00000080:0.0:1788612579.728394:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af4158d 00000100:00080000:0.0:1788612579.728401:0:12976:0:(import.c:65:import_set_state_nolock()) ffff928d85250000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788612579.728426:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788612579.729191:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928d8524d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788612579.729253:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928d8524c800 for lustre-MDT0000 00000020:00080000:0.0:1788612579.729649:0:12976:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff928d85250800): rc 0 00000020:00000080:0.0:1788612579.729652:0:12976:0:(genops.c:885:class_export_put()) final put ffff928d85250800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788612579.729666:0:12976:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa37a02b9bae0 00000020:00000080:3.0:1788612579.729681:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff928d85250800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1788612579.729697:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788612579.729701:0:12976:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000020:00000080:3.0:1788612579.729725:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928d85250000 for lustre-MDT0000 00000004:00080000:0.0:1788612579.729728:0:12976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788612579.729800:0:12976:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788612579.729818:0:12976:0:(import.c:65:import_set_state_nolock()) ffff928ebf87d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788612579.729866:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788612579.729868:0:12976:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788612579.729881:0:12976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788612579.729940:0:12976:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788612579.729949:0:12976:0:(import.c:65:import_set_state_nolock()) ffff928ebfb4e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788612579.729975:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff928e86f04d40) has no exports 00000100:00100000:1.0:1788612579.730177:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914391040:0@lo:9:umount.0 00000100:00100000:1.0:1788612579.730247:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612579.730290:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914391168:0@lo:9:umount.0 00000100:00100000:1.0:1788612579.730316:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612579.730360:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914391040 00000100:00100000:1.0:1788612579.730366:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914391040 00000100:00100000:1.0:1788612579.730421:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914391168 00000100:00100000:1.0:1788612579.730424:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914391168 00000100:00100000:3.0:1788612579.730450:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788612579.730469:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec034c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875495914391040:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788612579.730492:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af415da 00000100:00080000:3.0:1788612579.730508:0:6695:0:(import.c:65:import_set_state_nolock()) ffff928d8529f000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788612579.730597:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788612579.730606:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875495914391168:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788612579.730626:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af416c8 00000100:00080000:1.0:1788612579.730632:0:6697:0:(import.c:65:import_set_state_nolock()) ffff928ebfb4b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788612579.731117:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1788612579.731287:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612579.731302:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788612579.731406:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788612579.731504:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec034c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3304:x1875495914391040:12345-0@lo:9:umount.0 Request processed in 1043us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612579.731515:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788612579.731650:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3304:x1875495914391168:12345-0@lo:9:umount.0 Request processed in 1045us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612579.731657:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788612579.731675:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612579.731698:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612579.731733:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928ebf87d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788612579.731746:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788612579.731749:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788612579.731752:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914391040:0@lo:9:umount.0 00000100:00080000:1.0:1788612579.731763:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928ebfb4e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788612579.731777:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788612579.731779:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788612579.731782:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914391168:0@lo:9:umount.0 00010000:00010000:2.0:1788612579.732015:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788612579.741263:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff928e86f04d40) has no exports 00000020:00000080:1.0:1788612579.775140:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af4149f 00000020:00000080:1.0:1788612579.775155:0:12976:0:(genops.c:885:class_export_put()) final put ffff928ebfea2000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788612579.775181:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788612579.775282:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612579.775293:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788612579.775298:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff928e91143380) has no exports 00000020:00000080:2.0:1788612579.775441:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928ebfea2000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788612579.775629:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af41498 00000020:00000080:0.0:1788612579.775636:0:12976:0:(genops.c:885:class_export_put()) final put ffff928eade8f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788612579.775694:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612579.775701:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788612579.775704:0:12976:0:(genops.c:885:class_export_put()) final put ffff928eade8a000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788612579.775706:0:12976:0:(genops.c:844:class_export_destroy()) destroying export ffff928eade8a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788612579.775713:0:12976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788612579.775885:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928eade8f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788612579.775988:0:12976:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff928e86273780 - data ffff928eaa7fe948/ffff928ec064a400 00000020:01000000:1.0:1788612579.776130:0:12976:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff928e82bd5060 - data ffff928eaa73a6c0/ffff928ea37f1000 00000001:00000004:0.0:1788612579.798108:0:12976:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788612579.836710:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788612579.836730:0:12976:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788612579.837110:0:12976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788612579.837114:0:12976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788612579.837985:0:7001:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788612579.837990:0:7001:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1788612579.838000:0:7001:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788612579.840134:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788612579.840141:0:12976:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788612579.840162:0:12976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788612579.840165:0:12976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788612579.840432:0:8111:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788612579.840437:0:8111:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788612579.840447:0:8111:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788612579.875283:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af41467 00000020:00000080:3.0:1788612579.875296:0:12976:0:(genops.c:885:class_export_put()) final put ffff928ec09b9000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788612579.876592:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af4147c 00000020:00000080:3.0:1788612579.876601:0:12976:0:(genops.c:885:class_export_put()) final put ffff928ec09bb800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788612579.876608:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788612579.876615:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612579.876623:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788612579.876627:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff928e86f03380) has no exports 00000004:01000000:3.0:1788612579.876776:0:12976:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788612579.876784:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af416ba 00000020:00000080:3.0:1788612579.876788:0:12976:0:(genops.c:885:class_export_put()) final put ffff928d8524e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788612579.876791:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788612579.876795:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612579.876800:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788612579.876803:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff928e911419c0) has no exports 00000020:00000080:3.0:1788612579.876808:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af416b3 00000020:00000080:3.0:1788612579.876826:0:12976:0:(genops.c:885:class_export_put()) final put ffff928ebfb4e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788612579.877007:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928ec09b9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788612579.877019:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928ec09bb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788612579.877024:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928d8524e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788612579.877028:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928ebfb4e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788612579.877476:0:12976:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788612579.877481:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788612579.877485:0:12976:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1788612579.877491:0:12976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788612579.877494:0:12976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788612579.877574:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612579.877582:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788612579.877599:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af415d3 00000020:00000080:3.0:1788612579.877604:0:12976:0:(genops.c:885:class_export_put()) final put ffff928ebf87e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788612579.878113:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928ebfb4e000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788612579.878122:0:38:0:(genops.c:885:class_export_put()) final put ffff928d8507c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788612579.878126:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928d8507c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788612579.878131:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788612579.878272:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788612579.878277:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612579.878283:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788612579.878286:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff928ec092b380) has no exports 00000020:00000080:3.0:1788612579.878291:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af415cc 00000020:00000080:3.0:1788612579.878296:0:12976:0:(genops.c:885:class_export_put()) final put ffff928ebf878000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788612579.878629:0:12976:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788612579.878633:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788612579.878637:0:12976:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788612579.878642:0:12976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788612579.878643:0:12976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788612579.878675:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612579.878681:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788612579.878705:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612579.878709:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788612579.878712:0:12976:0:(genops.c:885:class_export_put()) final put ffff928e86c00800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788612579.878715:0:12976:0:(genops.c:844:class_export_destroy()) destroying export ffff928e86c00800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788612579.878720:0:12976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788612579.878947:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928ebf87e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788612579.878954:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928ebf878000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788612579.878958:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928ebf87d800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788612579.878963:0:38:0:(genops.c:885:class_export_put()) final put ffff928e86c02800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788612579.878965:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928e86c02800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788612579.878969:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788612579.879172:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af41483 00000020:00000080:3.0:1788612579.879179:0:12976:0:(genops.c:885:class_export_put()) final put ffff928ec09bf800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788612579.879195:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788612579.879200:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612579.879205:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788612579.879207:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff928e86f019c0) has no exports 00000020:00000080:3.0:1788612579.879238:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612579.879242:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788612579.879245:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af4148a 00000020:00000080:3.0:1788612579.879249:0:12976:0:(genops.c:885:class_export_put()) final put ffff928ec09bd000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788612579.879261:0:12976:0:(tgt_mount.c:187:server_put_mount()) put mount ffff928e98e67000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788612579.879265:0:12976:0:(obd_mount.c:710:lustre_put_lsi()) put ffff928e98e67000 3 00000020:01000004:3.0:1788612579.879277:0:12976:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff928e98e67000 from lustre-MDT0000 00000020:00000080:3.0:1788612579.879294:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612579.879299:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788612579.879302:0:12976:0:(genops.c:885:class_export_put()) final put ffff928ec09b9800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788612579.879304:0:12976:0:(genops.c:844:class_export_destroy()) destroying export ffff928ec09b9800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788612579.879311:0:12976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788612579.879335:0:12976:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788612579.879339:0:12976:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788612579.879341:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788612579.879344:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612579.879347:0:12976:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788612579.879354:0:12976:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff928e90d5a800 22c69a0a-d366-4936-9310-01935a424f88 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788612579.879359:0:12976:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff928e91140000) has exports, disconnecting them 00000020:00080000:3.0:1788612579.879364:0:12976:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff928e90d5a800), last request at 1788612355 00000020:00000080:3.0:1788612579.879376:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af41428 00000020:00010000:3.0:1788612579.879381:0:12976:0:(genops.c:1921:obd_stale_export_put()) Put export ffff928e90d5a800: total 2 00000100:00080000:3.0:1788612579.879385:0:12976:0:(import.c:65:import_set_state_nolock()) ffff928e90d5b000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788612579.879453:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928ec09bf800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788612579.879457:0:38:0:(genops.c:885:class_export_put()) final put ffff928ec09be800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788612579.879459:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928ec09be800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788612579.879465:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788612579.879612:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928ec09bd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1788612579.879646:0:12976:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff928e90d5a800): rc 0 00000020:00080000:3.0:1788612579.879650:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff928e91140000) has no exports 00000100:00100000:3.0:1788612579.879711:0:5844:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff928e86f49600:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1788612579.879892:0:5846:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff928e9233e200:5846] 1 exiting: rc = 0 00000100:00100000:2.0:1788612579.879987:0:5847:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff928e9233e000:5847] 2 exiting: rc = 0 00000100:00100000:3.0:1788612579.880080:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880088:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880093:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880099:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880105:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880110:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880116:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880127:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880134:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880140:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880146:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880163:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880169:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880174:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880179:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880185:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880192:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880199:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880205:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880222:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880228:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880234:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880239:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880245:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880250:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880256:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880261:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880267:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880273:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880278:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880283:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880288:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880293:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880298:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880303:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880308:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880314:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880320:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880325:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880330:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880335:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880341:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880346:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880351:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880356:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880361:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880373:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880379:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880384:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880389:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880394:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880400:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880405:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880411:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880417:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880422:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880428:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880433:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880438:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880444:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880449:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880454:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880459:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.880464:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788612579.880806:0:12976:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788612579.880809:0:12976:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:0.0:1788612579.881929:0:5841:0:(genops.c:1907:obd_stale_export_get()) Get export ffff928e90d5a800: total 0 00010000:00010000:0.0:1788612579.881973:0:5841:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff928e90d5a800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788612579.882004:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea0145400/0xfc956d548af41738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af41731 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.882022:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e910d7800/0xfc956d548af41746 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af4173f expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.882046:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e9400/0xfc956d548af41754 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af4174d expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.882055:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea0145200/0xfc956d548af41762 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af4175b expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.882066:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e8400/0xfc956d548af4196f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af41968 expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.882076:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea7bde000/0xfc956d548af4197d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af41976 expref: 4 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.882093:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea0145000/0xfc956d548af41540 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af41539 expref: 3 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.882104:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e80030c00/0xfc956d548af4178c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfc956d548af41785 expref: 2 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612579.882114:0:5841:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff928e90d5a800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788612579.882126:0:5841:0:(genops.c:885:class_export_put()) final put ffff928e90d5a800/22c69a0a-d366-4936-9310-01935a424f88 00010000:00010000:0.0:1788612579.882139:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612579.882141:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612579.882142:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788612579.882151:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928e90d5a800/22c69a0a-d366-4936-9310-01935a424f88 for MGS 00000020:00000080:0.0:1788612579.882180:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928e90d5b000 for MGS 00000020:01000000:3.0:1788612579.882279:0:12976:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff928e9103c480 - data ffff928eba71dd80/ffff928eacf95400 00000020:01000000:3.0:1788612579.882418:0:12976:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff928ea3782a80 - data ffff928eaa725870/ffff928eab903c00 00000020:00000080:3.0:1788612579.883123:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af4140c 00000020:00000080:3.0:1788612579.883130:0:12976:0:(genops.c:885:class_export_put()) final put ffff928e99315800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788612579.883251:0:12976:0:(tgt_mount.c:187:server_put_mount()) put mount ffff928e98e67000 from MGS, refs=2 00000020:01000004:3.0:1788612579.883255:0:12976:0:(obd_mount.c:710:lustre_put_lsi()) put ffff928e98e67000 2 00000020:01000004:3.0:1788612579.883258:0:12976:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff928e98e67000 from MGS 00000020:00000080:3.0:1788612579.883278:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612579.883283:0:12976:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788612579.883286:0:12976:0:(genops.c:885:class_export_put()) final put ffff928e99310800/MGS 00000020:00000080:3.0:1788612579.883288:0:12976:0:(genops.c:844:class_export_destroy()) destroying export ffff928e99310800/MGS for MGS 00000020:01000000:3.0:1788612579.883294:0:12976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788612579.883339:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788612579.883343:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612579.883356:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788612579.883362:0:12976:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff928eacc7f000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788612579.883367:0:12976:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff928e90d4cd40) has exports, disconnecting them 00000020:00080000:3.0:1788612579.883371:0:12976:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff928eacc7f000), last request at 1788612356 00000020:00000080:3.0:1788612579.883375:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af414d7 00000020:00080000:3.0:1788612579.883383:0:12976:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff928eacc7f000): rc 0 00000020:00000080:3.0:1788612579.883387:0:12976:0:(genops.c:885:class_export_put()) final put ffff928eacc7f000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788612579.883667:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff928e99315800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788612579.884830:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff928eacc7f000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788612579.905911:0:12976:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788612579.905930:0:12976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788612579.905935:0:12976:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788612579.905942:0:12976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788612579.906135:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612579.906144:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788612579.906150:0:12976:0:(obd_mount.c:710:lustre_put_lsi()) put ffff928e98e67000 1 00000020:00000080:2.0:1788612579.906157:0:12976:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af413fe 00000020:00000080:2.0:1788612579.906165:0:12976:0:(genops.c:885:class_export_put()) final put ffff928e99312800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788612579.906171:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788612579.906175:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612579.906179:0:12976:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788612579.906182:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff928e86f00000) has no exports 00000020:00000080:0.0:1788612579.906297:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928eacc7d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788612579.906305:0:36:0:(genops.c:885:class_export_put()) final put ffff928eba2bd000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788612579.906314:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff928eba2bd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788612579.906321:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788612579.906379:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff928e99312800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788612579.937439:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612579.937453:0:12976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788612579.937459:0:12976:0:(genops.c:885:class_export_put()) final put ffff928e82dcb000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788612579.937463:0:12976:0:(genops.c:844:class_export_destroy()) destroying export ffff928e82dcb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788612579.937474:0:12976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788612579.937594:0:12976:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff928e98e63800 00000020:01000000:2.0:1788612579.937618:0:12976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788612579.937622:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612579.937626:0:12976:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788612579.937630:0:12976:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff928e90d4b380) has no exports 00000100:00100000:2.0:1788612579.937716:0:5854:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff928e92391c00:5854] 2 exiting: rc = 0 00000100:00100000:2.0:1788612579.937823:0:5852:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff928e91c2e400:5852] 0 exiting: rc = 1 00000100:00100000:2.0:1788612579.938982:0:8316:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff928ec08d2600:8316] 3 exiting: rc = 0 00000100:00100000:1.0:1788612579.940461:0:5853:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff928e92390000:5853] 1 exiting: rc = 0 00000100:00100000:2.0:1788612579.941007:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941015:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941021:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941027:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941032:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941039:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941044:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941062:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941069:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941074:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941079:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941086:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941092:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941097:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941103:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941108:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941114:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941119:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941125:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941130:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941135:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941141:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941146:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941152:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941157:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941162:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941167:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941173:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941178:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941185:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941190:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941196:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941200:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941205:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941221:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941227:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941233:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941253:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941259:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941266:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941271:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941276:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941287:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941293:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941298:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941303:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941308:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941313:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941318:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941324:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941329:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941335:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941340:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941346:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941351:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941356:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941360:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941365:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941371:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941376:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941381:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941389:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941395:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.941400:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612579.945661:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff928e92391a00:5855] 0 exiting: rc = 1 00010000:00010000:2.0:1788612579.950960:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612579.953077:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff928e92391600:5856] 1 exiting: rc = 0 00000100:00100000:0.0:1788612579.953199:0:12070:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff928ec08d3600:12070] 2 exiting: rc = 0 00000100:00100000:2.0:1788612579.953413:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953423:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953429:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953436:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953441:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953446:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953451:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953456:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953462:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953467:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953473:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953480:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953501:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953505:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953510:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953515:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953521:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953526:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953532:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953536:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953541:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953547:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953552:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953558:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953563:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953568:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953573:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953578:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953584:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953589:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953594:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953599:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953603:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953608:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953613:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953618:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953623:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953629:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953634:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953639:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953644:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953649:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953654:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953659:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953663:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953668:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953672:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953686:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953690:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953695:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953700:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953705:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953710:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953715:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953720:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953725:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953730:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953735:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953741:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953746:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953751:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953756:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953761:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.953766:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.954279:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff928e92390c00:5857] 0 exiting: rc = 1 00000100:00100000:0.0:1788612579.954546:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff928e92391000:5858] 1 exiting: rc = 0 00000100:00100000:2.0:1788612579.955472:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955480:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955488:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955495:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955501:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955507:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955513:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955520:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955526:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955532:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955553:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955560:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955566:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955572:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955577:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955583:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955590:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955606:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955612:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955617:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955623:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955629:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955648:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955655:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955662:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955668:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955673:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955682:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955688:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955694:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955700:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955708:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955714:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955720:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955741:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955747:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955753:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955759:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955765:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955771:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955776:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955782:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955788:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955794:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955800:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955806:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955859:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955867:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955872:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955878:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955884:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955890:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955902:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955908:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955915:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955920:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955926:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955931:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955954:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955960:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955966:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955973:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955978:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.955984:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612579.966876:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff928e92391400:5859] 0 exiting: rc = 1 00000100:00100000:2.0:1788612579.967119:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff928e92390800:5860] 1 exiting: rc = 0 00000100:00100000:2.0:1788612579.967179:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967187:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967192:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967197:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967203:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967209:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967227:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967232:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967237:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967243:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967248:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967253:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967258:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967264:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967270:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967275:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967280:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967286:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967291:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967296:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967301:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967307:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967324:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967329:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967334:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967338:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967343:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967348:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967353:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967358:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967364:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967369:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967374:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967379:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967384:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967389:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967395:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967400:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967405:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967410:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967416:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967421:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967426:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967432:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967437:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967442:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967448:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967453:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967458:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967463:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967468:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967473:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967478:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967483:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967489:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967494:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967499:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967513:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967518:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967523:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967528:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967533:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967538:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.967543:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612579.968428:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff928e923d4400:5862] 1 exiting: rc = 0 00000100:00100000:3.0:1788612579.968568:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff928e923d5600:5861] 0 exiting: rc = 1 00000100:00100000:2.0:1788612579.968730:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968737:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968742:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968747:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968753:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968758:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968763:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968767:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968772:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968777:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968783:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968788:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968793:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968799:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968803:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968808:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968823:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968829:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968961:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968970:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968974:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968980:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968985:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968990:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.968995:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969000:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969005:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969010:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969195:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969200:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969205:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969210:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969280:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969285:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969291:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969296:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969300:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969305:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969310:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969315:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969320:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969324:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969329:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969333:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969338:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969343:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969348:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969353:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969357:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969362:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969368:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969373:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969378:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969383:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969388:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969393:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969398:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969403:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969408:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969414:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969419:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969423:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969428:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.969441:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612579.970181:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff928e923d5000:5863] 0 exiting: rc = 1 00000100:00100000:2.0:1788612579.970478:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff928e923d5400:5864] 1 exiting: rc = 0 00000100:00100000:2.0:1788612579.970529:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970536:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970541:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970547:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970552:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970556:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970562:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970567:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970572:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970577:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970583:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970588:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970593:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970598:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970602:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970607:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970612:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970618:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970622:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970626:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970632:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970636:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970641:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970646:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970651:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970656:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970662:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970667:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970672:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970677:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970681:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970687:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970694:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970708:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970713:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970717:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970722:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970726:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970731:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970736:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970741:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970745:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970750:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970755:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970760:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970764:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970769:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970774:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970779:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970784:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970790:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970794:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970800:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970805:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970918:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970927:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970932:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970937:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970942:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970948:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970952:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970957:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970961:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.970966:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612579.971579:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff928e923d5200:5865] 0 exiting: rc = 1 00000100:00100000:2.0:1788612579.972251:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff928e923d4600:5866] 1 exiting: rc = 0 00000100:00100000:3.0:1788612579.972498:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff928e98ec2600:5867] 2 exiting: rc = 0 00000100:00100000:2.0:1788612579.972651:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972659:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972665:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972681:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972687:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972709:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972715:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972721:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972726:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972731:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972737:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972742:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972748:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972754:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972759:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972764:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972770:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972776:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972781:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972787:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972792:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972798:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972803:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972810:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972825:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972831:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972858:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972864:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972869:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972888:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972895:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972900:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972905:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972911:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972917:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972923:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972928:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972934:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972945:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972949:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972954:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972960:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972965:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972970:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972975:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972980:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972986:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972992:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.972997:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973004:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973009:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973166:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973173:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973191:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973197:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973203:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973208:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973223:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973229:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973235:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973240:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973245:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973250:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612579.973264:0:12976:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788612579.977918:0:12976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612579.977930:0:12976:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788612579.977936:0:12976:0:(genops.c:885:class_export_put()) final put ffff928e92368800/MDS_uuid 00000020:00000080:2.0:1788612579.977941:0:12976:0:(genops.c:844:class_export_destroy()) destroying export ffff928e92368800/MDS_uuid for MDS 00000020:01000000:2.0:1788612579.977947:0:12976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788612579.978072:0:12976:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1788612580.911451:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914391424:0@lo:400:kworker.0 00000400:00000100:0.0:1788612580.911506:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495914391424 offset 0 length 224: 4 00000100:00100000:0.0:1788612580.911556:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612580.911562:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914391296:0@lo:400:kworker.0 00000400:00000100:0.0:1788612580.911581:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875495914391296 offset 0 length 224: 4 00000100:00100000:0.0:1788612580.911608:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875495914391552:0@lo:400:kworker.0 00000400:00000100:0.0:1788612580.911626:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495914391552 offset 0 length 224: 4 00010000:00010000:0.0:1788612580.977611:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612582.000527:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788612582.933862:0:13126:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788612582.961363:0:13126:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788612582.961414:0:13126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.961431:0:13126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.961438:0:13126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.961458:0:13126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612582.961488:0:13126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788612582.961494:0:13126:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788612582.961516:0:13126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612582.961527:0:13126:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff928eacd58a80 x1875495914391424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612596 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612582.961550:0:13126:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788612582.961556:0:13126:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788612582.961589:0:13126:0:(import.c:65:import_set_state_nolock()) ffff928e86c05000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788612582.961665:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612582.961672:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612582.961701:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612582.961712:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612582.961720:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612582.961726:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612582.961732:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788612582.961734:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788612582.961736:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788612582.961762:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612582.961778:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612582.961802:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612582.961810:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e90b61200/0xfc956d548af4174d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xfc956d548af41754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612582.961820:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875495914391680:0@lo:39:umount.0 00010000:00010000:2.0:1788612582.961827:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612582.961829:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612582.961830:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612582.961863:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612582.961873:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914391808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612582.961952:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914391424:0@lo:400:kworker.0 00000100:00100000:2.0:1788612582.962725:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612582.962916:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914391808 00000100:00100000:3.0:1788612582.962924:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914391808 00000100:00100000:3.0:1788612582.962969:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788612582.962977:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e92345c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3307:x1875495914391808:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788612582.962983:0:11669:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788612582 with bad export cookie 18200573678963659816 00000400:00000100:1.0:1788612582.973247:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495914391680 offset 0 length 224: 4 00000100:00100000:2.0:1788612582.980525:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e92345c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3307:x1875495914391808:12345-0@lo:103:ldlm_bl.0 Request processed in 17537us (17792us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788612582.980540:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788612582.980792:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788612582.980798:0:3307:0:(import.c:65:import_set_state_nolock()) ffff928e86f5d000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788612582.980801:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788612582.996279:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.106@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788612582.996285:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788612582.996294:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff928eacd5a300 x1875495914391296/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788612596 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612582.996323:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff928d8792ed80 x1875495914391808/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788612598 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788612582.996334:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788612582.996336:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788612582.996338:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788612582.996341:0:3307:0:(import.c:65:import_set_state_nolock()) ffff928e86f5d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612582.996346:0:3307:0:(import.c:545:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 149 00000100:00080000:0.0:1788612582.996356:0:3307:0:(import.c:665:import_select_connection()) MGC192.168.202.106@tcp: import ffff928e86f5d000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1788612582.996393:0:3307:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928eacd5b100 x1875495914391936/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612582.996558:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:22c69a0a-d366-4936-9310-01935a424f88:3304:1875495914391936:0@lo:250:ptlrpcd_00_02.0 00000100:00100000:2.0:1788612582.996725:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22c69a0a-d366-4936-9310-01935a424f88:3306:1875495914391296:0@lo:400:kworker.0 00000400:00000100:1.0:1788612582.997299:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875495914391936 offset 0 length 520: 4 00000100:00100000:0.0:1788612582.997663:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22c69a0a-d366-4936-9310-01935a424f88:3307:1875495914391808:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612583.020112:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612584.062608:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788612584.081558:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788612584.081569:0:7644:0:(genops.c:885:class_export_put()) final put ffff928ebfb49000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788612584.081625:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff928ebfb49000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788612584.081690:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928ebfb4b800 for lustre-OST0001 00000001:00100000:2.0:1788612584.550232:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788612584.550242:0:6721:0:(genops.c:885:class_export_put()) final put ffff928d8529a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788612584.550335:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff928d8529a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788612584.550645:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928d8529f000 for lustre-OST0000 00010000:00010000:3.0:1788612585.068485:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788612586.028095:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 22c69a0a-d366-4936-9310-01935a424f88->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788612586.028118:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 22c69a0a-d366-4936-9310-01935a424f88->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788612586.028241:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612586.028275:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914392064:0@lo:400:kworker.0 00000400:00000100:2.0:1788612586.028344:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495914392064 offset 0 length 224: 4 00010000:00010000:3.0:1788612586.092743:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612587.118169:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788612588.076242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 22c69a0a-d366-4936-9310-01935a424f88->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788612588.076253:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 22c69a0a-d366-4936-9310-01935a424f88->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788612588.076327:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612588.076346:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914392192:0@lo:400:kworker.0 00000400:00000100:1.0:1788612588.076418:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495914392192 offset 0 length 224: 4 00010000:00010000:3.0:1788612588.141099:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612589.166735:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612590.188147:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612591.213056:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612592.171923:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612582/real 1788612582] req@ffff928eacd5b100 x1875495914391936/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788612592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612592.171954:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff928eacd5b100 x1875495914391936/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788612592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612592.171965:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612582/real 1788612582] req@ffff928eacd5ad80 x1875495914391680/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788612592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612592.171976:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff928eacd5ad80 x1875495914391680/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788612592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788612592.171994:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928e86f5d000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612592.172012:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788612592.172016:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:22c69a0a-d366-4936-9310-01935a424f88:3304:1875495914391936:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1788612592.172022:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928e86c05000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788612592.172044:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875495914391680:0@lo:39:umount.0 00000100:00080000:2.0:1788612592.172131:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 22c69a0a-d366-4936-9310-01935a424f88->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788612592.172137:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788612592.172140:0:36:0:(import.c:65:import_set_state_nolock()) ffff928e86f5d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788612592.172145:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 376 00000100:00080000:2.0:1788612592.172150:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.106@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788612592.172157:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.106@tcp: import ffff928e86f5d000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1788612592.172199:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928d8792d500 x1875495914392320/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788612592.172242:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612592.172246:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:22c69a0a-d366-4936-9310-01935a424f88:3304:1875495914392320:0@lo:250:kworker.0 00000100:00100000:2.0:1788612592.172249:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914392448:0@lo:400:kworker.0 00000100:00080000:3.0:1788612592.172321:0:13126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788612592.172326:0:13126:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788612592.172330:0:13126:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000400:00000100:2.0:1788612592.172436:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495914392448 offset 0 length 224: 4 00010000:00010000:3.0:1788612592.173718:0:13126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41762 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.173733:0:13126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41762 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.173740:0:13126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af41762 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.173748:0:13126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af41762 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.173808:0:13126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612592.173816:0:13126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4197d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.173822:0:13126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4197d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.173828:0:13126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af4197d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.173833:0:13126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af4197d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.173870:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612592.173876:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af41762 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612592.173881:0:13126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788612592.173885:0:13126:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1788612592.173900:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612592.173903:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af41762 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788612592.173905:0:13126:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788612592.173909:0:13126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:2.0:1788612592.173911:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xfc956d548af41762 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788612592.173913:0:13126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612592.173918:0:13126:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 10000000:00010000:2.0:1788612592.173918:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xfc956d548af41762 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788612592.173922:0:13126:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff928e90d399c0) has no exports 10000000:01000000:2.0:1788612592.173923:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788612592.173925:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788612592.173927:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788612592.173939:0:5841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff928e86f5d000 00010000:00010000:2.0:1788612592.173943:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xfc956d548af41762 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788612592.173945:0:13126:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff928e90d399c0) has no exports 00010000:00010000:2.0:1788612592.173950:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d7000/0xfc956d548af4175b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xfc956d548af41762 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.173962:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612592.173965:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af4197d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.173971:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612592.173973:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af4197d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.173980:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfc956d548af4197d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612592.173992:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfc956d548af4197d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612592.173998:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788612592.174000:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788612592.174001:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788612592.174006:0:5841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff928e86f5d000 00010000:00010000:2.0:1788612592.174009:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfc956d548af4197d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.174015:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928ec21e9200/0xfc956d548af41976 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfc956d548af4197d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612592.174023:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612592.174025:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612592.174027:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612592.174129:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1788612592.177054:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875495914392320 offset 0 length 520: 4 00000020:01000000:3.0:1788612592.177649:0:13126:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff928e86273480 - data ffff928eafed1bd0/ffff928ec0649000 00000020:01000000:3.0:1788612592.177773:0:13126:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff928e98eb5900 - data ffff928e8214d0d8/ffff928eacf68800 00100000:10000000:3.0:1788612592.193564:0:13126:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788612592.236728:0:13126:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af4155c 00000020:00000080:0.0:1788612592.236738:0:13126:0:(genops.c:885:class_export_put()) final put ffff928d85048000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788612592.236757:0:13126:0:(tgt_mount.c:187:server_put_mount()) put mount ffff928e9162f000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788612592.236760:0:13126:0:(obd_mount.c:710:lustre_put_lsi()) put ffff928e9162f000 2 00000020:01000004:0.0:1788612592.236764:0:13126:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff928e9162f000 from lustre-OST0000 00000020:00000080:0.0:1788612592.236784:0:13126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612592.236794:0:13126:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788612592.236797:0:13126:0:(genops.c:885:class_export_put()) final put ffff928d8504b800/lustre-OST0000_UUID 00000020:00000080:0.0:1788612592.236799:0:13126:0:(genops.c:844:class_export_destroy()) destroying export ffff928d8504b800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788612592.236807:0:13126:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788612592.236903:0:13126:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788612592.236908:0:13126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788612592.236912:0:13126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612592.236917:0:13126:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788612592.236923:0:13126:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff928d85058800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788612592.236929:0:13126:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff928ec0928000) has exports, disconnecting them 00000020:00080000:0.0:1788612592.236933:0:13126:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff928d85058800), last request at 1788612373 00000020:00000080:0.0:1788612592.236937:0:13126:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af41586 00000020:00080000:0.0:1788612592.236946:0:13126:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff928d85058800): rc 0 00000020:00000080:0.0:1788612592.236951:0:13126:0:(genops.c:885:class_export_put()) final put ffff928d85058800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788612592.239240:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff928d85048000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788612592.239264:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff928d85058800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788612592.239987:0:13126:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788612592.239993:0:13126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788612592.239997:0:13126:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788612592.240004:0:13126:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788612592.240986:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928e86c05000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788612592.241164:0:13126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612592.241182:0:13126:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788612592.241187:0:13126:0:(genops.c:885:class_export_put()) final put ffff928d85059000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788612592.241191:0:13126:0:(genops.c:844:class_export_destroy()) destroying export ffff928d85059000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788612592.241201:0:13126:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788612592.241256:0:13126:0:(obd_mount.c:710:lustre_put_lsi()) put ffff928e9162f000 1 00000020:00000080:1.0:1788612592.241263:0:13126:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af41516 00000020:00000080:1.0:1788612592.241269:0:13126:0:(genops.c:885:class_export_put()) final put ffff928e92233000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788612592.241278:0:13126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788612592.241291:0:13126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612592.241295:0:13126:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788612592.241299:0:13126:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff928e90d3cd40) has no exports 00000020:00000080:3.0:1788612592.243574:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff928e92233000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788612592.268363:0:13126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612592.268378:0:13126:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788612592.268383:0:13126:0:(genops.c:885:class_export_put()) final put ffff928e9162d800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788612592.268387:0:13126:0:(genops.c:844:class_export_destroy()) destroying export ffff928e9162d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788612592.268398:0:13126:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788612592.270261:0:13126:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff928e9162d000 00000020:02000400:3.0:1788612592.270326:0:13126:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788612592.545913:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612593.582490:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612594.603996:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788612595.175956:0:13280:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788612595.192887:0:13280:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788612595.192989:0:13280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41738 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612595.193003:0:13280:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41738 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612595.193010:0:13280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af41738 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612595.193030:0:13280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af41738 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612595.195294:0:13280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788612595.195303:0:13280:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788612595.195339:0:13280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788612595.195353:0:13280:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff928eacd59c00 x1875495914391552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612596 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612595.195382:0:13280:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff928eb7fcea00 x1875495914392064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612602 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612595.195399:0:13280:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff928eab92c000 x1875495914392192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612604 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612595.195419:0:13280:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff928d8792f800 x1875495914392448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612608 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612595.195432:0:13280:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788612595.195481:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914392448:0@lo:400:kworker.0 00000100:00080000:3.0:1788612595.195530:0:13280:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788612595.195556:0:13280:0:(import.c:65:import_set_state_nolock()) ffff928d8524b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788612595.200819:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914392064:0@lo:400:kworker.0 00000100:00100000:3.0:1788612595.200900:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875495914391552:0@lo:400:kworker.0 00010000:00010000:3.0:1788612595.200920:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612595.200927:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af41738 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612595.200938:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d6a00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788612595.202166:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af41738 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612595.202186:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfc956d548af41738 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612595.202194:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfc956d548af41738 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612595.202200:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788612595.202203:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788612595.202209:0:5840:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788612595.202229:0:5840:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff928e86f5d000 00010000:00010000:3.0:1788612595.202233:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfc956d548af41738 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612595.202243:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d6a00/0xfc956d548af41731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfc956d548af41738 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612595.202263:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612595.202265:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612595.202282:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612595.202699:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875495914392576:0@lo:39:umount.0 00000400:00000100:3.0:1788612595.202757:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495914392576 offset 0 length 224: 4 00000100:00100000:3.0:1788612595.202833:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914392192:0@lo:400:kworker.0 00010000:00010000:2.0:1788612595.628615:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612596.652213:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788612597.294737:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 22c69a0a-d366-4936-9310-01935a424f88->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788612597.294749:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 22c69a0a-d366-4936-9310-01935a424f88->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788612597.676380:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612598.701342:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612599.724299:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612600.748303:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612601.772020:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788612602.412196:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 22c69a0a-d366-4936-9310-01935a424f88->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788612602.412208:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 22c69a0a-d366-4936-9310-01935a424f88->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788612602.796182:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612603.819995:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612604.844604:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612605.419968:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612595/real 1788612595] req@ffff928eb7fcca80 x1875495914392576/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788612605 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612605.420002:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff928eb7fcca80 x1875495914392576/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788612605 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788612605.420021:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928d8524b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788612605.420045:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875495914392576:0@lo:39:umount.0 00000100:00080000:2.0:1788612605.420147:0:13280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788612605.420153:0:13280:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788612605.420158:0:13280:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788612605.421083:0:13280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af41746 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612605.421098:0:13280:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af41746 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612605.421106:0:13280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af41746 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612605.421113:0:13280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af41746 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612605.421141:0:13280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612605.421148:0:13280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4196f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612605.421155:0:13280:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4196f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612605.421162:0:13280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af4196f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612605.421168:0:13280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfc956d548af4196f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612605.421188:0:13280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788612605.421193:0:13280:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788612605.421214:0:13280:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788612605.421228:0:13280:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788612605.421233:0:13280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612605.421239:0:13280:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788612605.421252:0:13280:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff928e90d38000) has no exports 00000020:00080000:2.0:1788612605.421280:0:13280:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff928e90d38000) has no exports 00010000:00010000:0.0:1788612605.421329:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612605.421337:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af41746 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612605.421347:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d6200 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788612605.421358:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af41746 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612605.421368:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfc956d548af41746 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612605.421376:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfc956d548af41746 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612605.421384:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788612605.421387:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788612605.421389:0:5840:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788612605.421404:0:5840:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff928e86f5d000 00010000:00010000:0.0:1788612605.421408:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfc956d548af41746 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612605.421416:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d6200/0xfc956d548af4173f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfc956d548af41746 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612605.421431:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612605.421435:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af4196f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612605.421441:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0076a00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:0.0:1788612605.421444:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfc956d548af4196f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612605.421451:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfc956d548af4196f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612605.421458:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfc956d548af4196f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612605.421471:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788612605.421473:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788612605.421475:0:5840:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788612605.421482:0:5840:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff928e86f5d000 00010000:00010000:0.0:1788612605.421484:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xfc956d548af4196f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612605.422352:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928ea0076a00/0xfc956d548af41968 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xfc956d548af4196f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612605.422375:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612605.422376:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612605.422379:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788612605.422960:0:13280:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff928e86273ba0 - data ffff928eaffaeaf8/ffff928d84992800 00000020:01000000:2.0:1788612605.423071:0:13280:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff928e98eb57e0 - data ffff928eba5e01b0/ffff928d86210800 00010000:00010000:3.0:1788612605.423667:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788612605.451669:0:13280:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788612605.486304:0:13280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af41627 00000020:00000080:0.0:1788612605.486314:0:13280:0:(genops.c:885:class_export_put()) final put ffff928ebfb4d000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788612605.486337:0:13280:0:(tgt_mount.c:187:server_put_mount()) put mount ffff928d85299000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788612605.486340:0:13280:0:(obd_mount.c:710:lustre_put_lsi()) put ffff928d85299000 2 00000020:01000004:0.0:1788612605.486343:0:13280:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff928d85299000 from lustre-OST0001 00000020:00000080:0.0:1788612605.486370:0:13280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612605.486380:0:13280:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788612605.486383:0:13280:0:(genops.c:885:class_export_put()) final put ffff928ebfb49800/lustre-OST0001_UUID 00000020:00000080:0.0:1788612605.486386:0:13280:0:(genops.c:844:class_export_destroy()) destroying export ffff928ebfb49800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788612605.486396:0:13280:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788612605.486502:0:13280:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 22c69a0a-d366-4936-9310-01935a424f88->MGS 00010000:00010000:0.0:1788612605.486518:0:13280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e910d6800/0xfc956d548af41539 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfc956d548af41540 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612605.486529:0:13280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e910d6800/0xfc956d548af41539 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfc956d548af41540 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612605.486550:0:13280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788612605.486553:0:13280:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788612605.486556:0:13280:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788612605.486571:0:13280:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff928e86f5d000 00010000:00010000:0.0:1788612605.486574:0:13280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e910d6800/0xfc956d548af41539 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfc956d548af41540 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612605.486589:0:13280:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928ec21e9c00/0xfc956d548af41785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfc956d548af4178c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612605.486595:0:13280:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928ec21e9c00/0xfc956d548af41785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfc956d548af4178c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612605.486600:0:13280:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788612605.486602:0:13280:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788612605.486604:0:13280:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788612605.486612:0:13280:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff928e86f5d000 00010000:00010000:0.0:1788612605.486615:0:13280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928ec21e9c00/0xfc956d548af41785 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfc956d548af4178c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788612605.486632:0:13280:0:(import.c:65:import_set_state_nolock()) ffff928e86f5d000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788612605.486636:0:13280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788612605.486638:0:13280:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788612605.486640:0:13280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788612605.486644:0:13280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788612605.486654:0:13280:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff928d8792d500 x1875495914392320/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788612607 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788612605.486677:0:13280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788612605.486679:0:13280:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1788612605.487115:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:22c69a0a-d366-4936-9310-01935a424f88:3304:1875495914392320:0@lo:250:kworker.0 10000000:01000000:0.0:1788612605.487205:0:13280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788612605.487229:0:13280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af4141a 00000020:00000080:0.0:1788612605.487234:0:13280:0:(genops.c:885:class_export_put()) final put ffff928e9236f800/22c69a0a-d366-4936-9310-01935a424f88 00000020:01000000:0.0:1788612605.487240:0:13280:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.106@tcp (flags='') 00000020:00000080:0.0:1788612605.487244:0:13280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612605.487249:0:13280:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.106@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788612605.487252:0:13280:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff928e90d3b380) has no exports 10000000:01000000:1.0:1788612605.487306:0:5849:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1788612605.488426:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928ebfb4d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788612605.488443:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928e9236f800/22c69a0a-d366-4936-9310-01935a424f88 for MGC192.168.202.106@tcp 10000000:01000000:0.0:1788612605.489431:0:13280:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.106@tcp: client import never connected 00000100:00080000:0.0:1788612605.489437:0:13280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788612605.489441:0:13280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788612605.489444:0:13280:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788612605.489447:0:13280:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788612605.489496:0:13280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612605.489503:0:13280:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.106@tcp (uuid 22c69a0a-d366-4936-9310-01935a424f88) 00000020:01000000:0.0:1788612605.489509:0:13280:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788612605.489514:0:13280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612605.489518:0:13280:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788612605.489525:0:13280:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff928d85248000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788612605.489530:0:13280:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff928d8583b380) has exports, disconnecting them 00000020:00080000:0.0:1788612605.489534:0:13280:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff928d85248000), last request at 1788612393 00000020:00000080:0.0:1788612605.489539:0:13280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af41651 00000020:00080000:0.0:1788612605.489553:0:13280:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff928d85248000): rc 0 00000020:00000080:0.0:1788612605.489558:0:13280:0:(genops.c:885:class_export_put()) final put ffff928d85248000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788612605.490945:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928e86f5d000 for MGC192.168.202.106@tcp 00000020:00000080:3.0:1788612605.490958:0:38:0:(genops.c:885:class_export_put()) final put ffff928e86f5f000/22c69a0a-d366-4936-9310-01935a424f88 00000020:00000080:3.0:1788612605.490961:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928e86f5f000/22c69a0a-d366-4936-9310-01935a424f88 for MGC192.168.202.106@tcp 00000020:01000000:3.0:1788612605.490968:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.106@tcp (22c69a0a-d366-4936-9310-01935a424f88) 00000020:00000080:3.0:1788612605.491246:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928d85248000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788612605.492934:0:13280:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788612605.492941:0:13280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788612605.492945:0:13280:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788612605.492951:0:13280:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788612605.493069:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff928d8524b800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788612605.497881:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788612605.498109:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1788612605.498273:0:7634:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff928ea78bd400:7634] 2 exiting: rc = 0 00000100:00100000:1.0:1788612605.498347:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff928e9168ac00:5836] 1 exiting: rc = 0 00000100:00100000:3.0:1788612605.499290:0:5835:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff928e91f98c00:5835] 0 exiting: rc = 1 00000100:00100000:1.0:1788612605.499462:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.499718:0:5839:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff928e9168a600:5839] 2 exiting: rc = 0 00000100:00100000:3.0:1788612605.500943:0:11669:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff928ec08d5a00:11669] 3 exiting: rc = 0 00000100:00100000:3.0:1788612605.501028:0:5837:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff928e9168ba00:5837] 0 exiting: rc = 1 00000100:00100000:3.0:1788612605.502993:0:5838:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff928e9168a200:5838] 1 exiting: rc = 0 00000100:00100000:1.0:1788612605.503378:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503387:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503394:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503401:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503406:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503412:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503431:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503437:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503443:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503447:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503453:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503467:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503474:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503480:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503491:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503499:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503505:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503511:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503516:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503522:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503527:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503533:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503538:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503543:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503548:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503554:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503559:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503565:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503570:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503575:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503580:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503585:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503590:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503595:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503600:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503605:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503610:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503616:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503621:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503626:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503632:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503645:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503650:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503655:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503660:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503665:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503671:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503675:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503681:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503686:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503691:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503697:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503702:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503706:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503711:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503716:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503722:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503727:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503732:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503738:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503743:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503749:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503754:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.503761:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788612605.506477:0:13280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612605.506490:0:13280:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788612605.506495:0:13280:0:(genops.c:885:class_export_put()) final put ffff928d853b6800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788612605.506500:0:13280:0:(genops.c:844:class_export_destroy()) destroying export ffff928d853b6800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788612605.506505:0:13280:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788612605.506555:0:13280:0:(obd_mount.c:710:lustre_put_lsi()) put ffff928d85299000 1 00000020:00000080:1.0:1788612605.506561:0:13280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfc956d548af415f6 00000020:00000080:1.0:1788612605.506566:0:13280:0:(genops.c:885:class_export_put()) final put ffff928ebfb4a000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788612605.506575:0:13280:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788612605.506579:0:13280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612605.506584:0:13280:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788612605.506596:0:13280:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff928e91144d40) has no exports 00000020:00000080:3.0:1788612605.506695:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff928ebfb4a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788612605.527408:0:13280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612605.527423:0:13280:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788612605.527429:0:13280:0:(genops.c:885:class_export_put()) final put ffff928d85299800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788612605.527434:0:13280:0:(genops.c:844:class_export_destroy()) destroying export ffff928d85299800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788612605.527455:0:13280:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788612605.527651:0:13280:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff928d8529a000 00000020:01000000:3.0:1788612605.527673:0:13280:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788612605.527677:0:13280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612605.527681:0:13280:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788612605.527697:0:13280:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff928ec09299c0) has no exports 00000020:00000080:3.0:1788612605.527723:0:13280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612605.527729:0:13280:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788612605.527731:0:13280:0:(genops.c:885:class_export_put()) final put ffff928e92235000/OSS_uuid 00000020:00000080:3.0:1788612605.527734:0:13280:0:(genops.c:844:class_export_destroy()) destroying export ffff928e92235000/OSS_uuid for OSS 00000020:01000000:3.0:1788612605.527737:0:13280:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788612605.527769:0:5848:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788612605.527966:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff928e923daa00:6695] 0 exiting: rc = 1 00000100:00100000:3.0:1788612605.528019:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff928ea37f4c00:6698] 2 exiting: rc = 0 00000100:00100000:1.0:1788612605.530521:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff928e923dbc00:6697] 1 exiting: rc = 0 00000100:00100000:1.0:1788612605.530614:0:8463:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff928e9168a000:8463] 3 exiting: rc = 0 00000100:00100000:2.0:1788612605.531641:0:12375:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff928ea7bb1000:12375] 4 exiting: rc = 0 00000100:00100000:3.0:1788612605.531795:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531805:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531811:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531825:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531831:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531855:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531861:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531867:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531873:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531878:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531885:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531890:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531895:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531900:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531906:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531910:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531915:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531921:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531926:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531930:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531952:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531957:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531963:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531968:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531972:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531978:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531983:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.531996:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532002:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532008:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532014:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532018:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532023:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532029:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532034:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532039:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532045:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532050:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532056:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532061:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532066:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532071:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532076:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532081:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532086:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532092:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532097:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532102:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532107:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532112:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532117:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532122:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532127:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532131:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532136:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532153:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532159:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532165:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532170:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532175:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532180:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532185:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532190:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.532201:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612605.533303:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff928ec071ac00:6699] 0 exiting: rc = 1 00000100:00100000:1.0:1788612605.533515:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff928ec071b000:6700] 1 exiting: rc = 0 00000100:00100000:3.0:1788612605.534703:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534714:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534719:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534724:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534729:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534734:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534740:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534745:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534750:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534755:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534760:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534766:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534771:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534776:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534782:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534788:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534793:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534798:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534803:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534808:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534813:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534826:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534831:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534862:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534868:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534872:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534890:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534895:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534900:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534905:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534909:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534914:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534919:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534923:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534927:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534932:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534937:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534942:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534948:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534954:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534959:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534965:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534971:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534976:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534980:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.534997:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535003:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535008:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535013:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535019:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535024:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535030:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535035:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535041:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535046:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535051:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535056:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535060:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535065:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535070:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535075:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535088:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535093:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.535099:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.539314:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff928ec06dd200:6701] 0 exiting: rc = 1 00000100:00100000:0.0:1788612605.539350:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff928ec071b800:6702] 1 exiting: rc = 0 00000100:00100000:1.0:1788612605.539495:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff928ec071b200:6703] 2 exiting: rc = 0 00000100:00100000:3.0:1788612605.540402:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540413:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540422:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540429:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540435:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540458:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540469:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540475:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540485:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540491:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540497:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540504:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540511:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540517:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540523:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540534:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540541:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540546:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540553:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540559:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540565:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540572:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540578:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540584:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540590:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540596:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540601:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540626:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540634:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540640:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540646:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540665:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540671:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540677:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540695:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540701:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540707:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540712:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540718:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540724:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540730:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540736:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540742:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540748:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540763:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540771:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540777:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540783:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540790:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540796:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540814:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540948:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540954:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540960:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540966:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540971:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540978:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540984:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540990:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.540996:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.541002:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.541007:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.541013:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.541021:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.555031:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff928e91caf600:6704] 0 exiting: rc = 1 00000100:00100000:3.0:1788612605.556230:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff928ec071be00:6705] 1 exiting: rc = 0 00000100:00100000:1.0:1788612605.556389:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556397:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556402:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556407:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556412:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556418:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556424:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556437:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556461:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556467:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556472:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556477:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556482:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556488:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556493:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556498:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556503:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556509:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556514:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556519:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556523:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556529:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556533:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556539:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556546:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556551:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556556:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556562:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556567:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556580:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556585:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556591:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556595:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556822:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556832:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556858:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556865:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556870:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556875:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556881:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556886:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556892:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556898:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556902:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556907:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556912:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556917:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556922:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556936:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556942:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556946:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556951:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556956:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556961:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556966:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556971:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556977:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556982:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556987:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556992:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.556997:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.557002:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.557007:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.557019:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612605.558557:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff928e98874400:6706] 0 exiting: rc = 1 00000100:00100000:3.0:1788612605.558646:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff928e98875000:6707] 1 exiting: rc = 0 00000100:00100000:1.0:1788612605.558821:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.558831:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.558853:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.558859:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.558868:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.558874:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.558880:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.558887:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.558892:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.558909:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.558918:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.558991:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559000:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559006:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559012:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559018:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559024:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559029:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559034:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559039:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559045:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559067:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559075:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559082:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559087:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559093:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559099:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559104:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559110:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559115:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559121:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559127:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559132:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559150:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559156:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559174:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559180:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559186:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559192:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559198:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559204:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559209:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559226:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559233:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559239:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559258:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559265:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559363:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559371:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559377:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559385:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559392:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559398:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559405:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559410:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559416:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559422:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559442:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559449:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559455:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559461:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559467:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559472:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612605.559478:0:13280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788612605.570461:0:13280:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788612623.057631:0:13897:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788612632.919827:0:14359:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788612632.919833:0:14359:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788612632.920227:0:14359:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff928e923eb800 00000020:01000004:3.0:1788612632.920243:0:14359:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788612632.920250:0:14359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788612632.920263:0:14359:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff928e90d499c0) 00000020:00000080:3.0:1788612632.920275:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788612632.941382:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788612632.944161:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788612632.944784:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1788612632.944963:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1788612632.945196:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1788612632.945294:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1788612632.945388:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1788612632.945575:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788612632.945646:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1788612632.946342:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1788612632.947602:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:3.0:1788612632.947782:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:3.0:1788612632.948594:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 771: rc = 0 00100000:10000000:3.0:1788612632.949154:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 771: rc = 0 00100000:10000000:3.0:1788612632.949421:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:3.0:1788612632.949668:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788612632.950465:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788612632.950955:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 771: rc = 0 00100000:10000000:2.0:1788612632.951338:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 771: rc = 0 00100000:10000000:2.0:1788612632.951590:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788612632.951951:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 771: rc = 0 00100000:10000000:2.0:1788612632.952326:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788612632.952573:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788612632.952948:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:2.0:1788612632.953503:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 704: rc = 0 00100000:10000000:2.0:1788612632.953820:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 704: rc = 0 00100000:10000000:2.0:1788612632.954333:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 704: rc = 0 00100000:10000000:2.0:1788612632.954570:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 704: rc = 0 00100000:10000000:2.0:1788612632.955202:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 704: rc = 0 00100000:10000000:2.0:1788612632.955416:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 704: rc = 0 00100000:10000000:2.0:1788612632.955648:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 704: rc = 0 00100000:10000000:2.0:1788612632.956180:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 704: rc = 0 00100000:10000000:2.0:1788612632.956425:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 704: rc = 0 00100000:10000000:2.0:1788612632.956782:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 704: rc = 0 00100000:10000000:2.0:1788612632.957350:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 704: rc = 0 00100000:10000000:2.0:1788612632.957593:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 704: rc = 0 00100000:10000000:2.0:1788612632.957963:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 704: rc = 0 00100000:10000000:2.0:1788612632.958778:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 704: rc = 0 00100000:10000000:2.0:1788612632.959279:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 704: rc = 0 00100000:10000000:2.0:1788612632.959658:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 704: rc = 0 00100000:10000000:2.0:1788612632.960119:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 704: rc = 0 00100000:10000000:2.0:1788612632.960444:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 704: rc = 0 00100000:10000000:2.0:1788612632.960825:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 704: rc = 0 00100000:10000000:2.0:1788612632.961266:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 704: rc = 0 00100000:10000000:2.0:1788612632.961636:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 704: rc = 0 00100000:10000000:2.0:1788612632.962141:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 704: rc = 0 00100000:10000000:2.0:1788612632.962391:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 704: rc = 0 00100000:10000000:2.0:1788612632.962634:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 704: rc = 0 00100000:10000000:2.0:1788612632.963153:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 704: rc = 0 00100000:10000000:2.0:1788612632.963560:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 704: rc = 0 00100000:10000000:2.0:1788612632.963874:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 704: rc = 0 00100000:10000000:2.0:1788612632.964150:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 704: rc = 0 00100000:10000000:2.0:1788612632.964409:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 704: rc = 0 00100000:10000000:2.0:1788612632.964668:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 704: rc = 0 00100000:10000000:2.0:1788612632.964962:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 704: rc = 0 00100000:10000000:2.0:1788612632.965236:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 704: rc = 0 00100000:10000000:2.0:1788612632.965568:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 277: rc = 0 00100000:10000000:2.0:1788612632.966801:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788612632.970644:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:2.0:1788612632.971162:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788612632.971244:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:2.0:1788612632.971436:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788612632.971511:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:2.0:1788612632.972144:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788612632.972211:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 540: rc = 0 00100000:10000000:2.0:1788612632.972407:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788612632.972478:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 540: rc = 0 00100000:10000000:2.0:1788612632.972654:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788612632.975575:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 540: rc = 0 00000020:00000080:2.0:1788612632.975927:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788612632.975935:0:14359:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788612632.975947:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfc956d548af4271b 00000020:01000004:2.0:1788612632.975955:0:14359:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788612632.975959:0:14359:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788612632.975964:0:14359:0:(tgt_mount.c:101:server_register_mount()) register mount ffff928e923eb800 from MGS 00000020:01000004:2.0:1788612632.975967:0:14359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788612632.975977:0:14359:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff928ec092b380) 00000020:00000080:2.0:1788612632.976246:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788612632.976310:0:14359:0:(tgt_mount.c:153:server_get_mount()) get mount ffff928e923eb800 from MGS, refs=2 00080000:01000000:2.0:1788612632.976316:0:14359:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788612632.976321:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfc956d548af42729 00000100:00100000:2.0:1788612632.976417:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788612632.976861:0:14359:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788612632.976869:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788612632.984354:0:14359:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788612632.984372:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788612632.986755:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612632.987360:0:14359:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788612632.987369:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788612632.988323:0:14359:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788612632.988332:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788612632.989186:0:14359:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788612632.989193:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788612632.990509:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612632.990514:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612632.990516:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612632.991242:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612632.991246:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612632.991248:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612632.996820:0:14359:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788612633.002222:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788612633.009691:0:14359:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788612633.009707:0:14359:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788612633.009709:0:14359:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788612633.012448:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788612633.012641:0:14359:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788612633.012749:0:14359:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788612633.013427:0:14359:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788612633.013732:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612633.013932:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788612633.013938:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788612633.018884:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788612633.018901:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788612633.019435:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788612633.019444:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788612633.021123:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788612633.021149:0:14359:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.106@tcp' 00000020:01000004:3.0:1788612633.021151:0:14359:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788612633.021185:0:14359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.106@tcp (typ=mgc) 00000020:00000080:3.0:1788612633.021199:0:14359:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.106@tcp (ffff928e90d48000) 00000020:00000080:3.0:1788612633.021215:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788612633.021291:0:14359:0:(ldlm_lib.c:102:import_set_conn()) imp ffff928d8770b800@MGC192.168.202.106@tcp: add connection 192.168.202.106@tcp at head 00010000:00010000:3.0:1788612633.021469:0:14359:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.106@tcp-0 is initialized 00000040:01000000:3.0:1788612633.021475:0:14359:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788612633.021595:0:14373:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788612633.025864:0:14374:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788612633.025982:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.106@tcp (uuid d8d85c8a-0380-4a63-8187-d0137cefd572) 00000020:00000080:0.0:1788612633.026017:0:14359:0:(genops.c:1385:class_connect()) connect: client d8d85c8a-0380-4a63-8187-d0137cefd572, cookie 0xfc956d548af42737 00000100:00080000:0.0:1788612633.026031:0:14359:0:(import.c:545:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788612633.026037:0:14359:0:(import.c:665:import_select_connection()) MGC192.168.202.106@tcp: import ffff928d8770b800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1788612633.026069:0:14359:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928eacd58e00 x1875495914392704/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612633.026111:0:14359:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d8d85c8a-0380-4a63-8187-d0137cefd572->MGS 00000020:01000004:0.0:1788612633.026136:0:14359:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788612633.026142:0:14359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788612633.026156:0:14359:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff928d8583cd40) 00000020:00000080:0.0:1788612633.026169:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788612633.026442:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d8d85c8a-0380-4a63-8187-d0137cefd572:3304:1875495914392704:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788612633.026511:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612633.031388:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914392704 00000100:00100000:2.0:1788612633.031404:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914392704 00000100:00100000:2.0:1788612633.031458:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612633.031467:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1875495914392704:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788612633.031496:0:14370:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d8d85c8a-0380-4a63-8187-d0137cefd572@0@lo t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:2.0:1788612633.031536:0:14370:0:(genops.c:1385:class_connect()) connect: client d8d85c8a-0380-4a63-8187-d0137cefd572, cookie 0xfc956d548af42745 00000100:00080000:2.0:1788612633.031677:0:14370:0:(import.c:65:import_set_state_nolock()) ffff928ec09bb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788612633.031774:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+5:3304:x1875495914392704:12345-0@lo:250:mount.lustre.0 Request processed in 307us (5263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612633.031783:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612633.031827:0:3304:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788612633.031861:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.106@tcp: connect to target with instance 0 00000100:00080000:2.0:1788612633.031869:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788612633.031874:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788612633.031877:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928d8770b800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788612633.031880:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788612633.031887:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788612633.031892:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d8d85c8a-0380-4a63-8187-d0137cefd572:3304:1875495914392704:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788612633.065461:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788612633.065686:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788612633.065693:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788612633.069361:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788612633.069380:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788612633.069798:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788612633.069806:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788612633.070586:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612633.070784:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788612633.070789:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788612633.071731:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788612633.071740:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788612633.115648:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612633.115948:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788612633.115955:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788612633.116656:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788612633.116663:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788612633.118031:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612633.118371:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788612633.118377:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788612633.119061:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788612633.119069:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788612633.120290:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612633.120411:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788612633.120420:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788612633.120748:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788612633.120755:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788612633.121626:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612633.121780:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788612633.121786:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788612633.122753:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788612633.122761:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788612633.155232:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612633.155457:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788612633.155465:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788612633.157413:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788612633.157426:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788612633.158457:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788612633.158467:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788612633.159989:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788612633.161488:0:14359:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788612633.161499:0:14359:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788612633.161650:0:14359:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788612633.161699:0:14359:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788612633.161704:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788612633.161706:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788612633.161707:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612633.161708:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612633.161710:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612633.161711:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612633.161712:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788612633.161714:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788612633.161715:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612633.161716:0:14359:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788612633.161719:0:14359:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788612633.161721:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788612633.161722:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788612633.161723:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612633.161724:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612633.161725:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612633.161727:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612633.161728:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788612633.161729:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788612633.161730:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612633.161731:0:14359:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788612633.161758:0:14359:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788612633.161784:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914392832:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788612633.161876:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612633.161926:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612633.162063:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914392832 00000100:00100000:3.0:1788612633.162071:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914392832 00000100:00100000:3.0:1788612633.162130:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612633.162139:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+5:14359:x1875495914392832:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788612633.162196:0:14372:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788612633.162198:0:14372:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788612633.162201:0:14372:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788612633.162811:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788612633.163232:0:14372:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788612633.165122:0:14394:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788612633.165130:0:14394:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788612633.165133:0:14394:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788612633.165171:0:14394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788612633.165470:0:14372:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788612633.165480:0:14372:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788612633.172117:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+5:14359:x1875495914392832:12345-0@lo:253:mount.lustre.0 Request processed in 9970us (10232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.172137:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612633.172229:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914392832:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788612633.172247:0:14359:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788612633.172251:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788612633.172253:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788612633.172254:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612633.172255:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612633.172257:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612633.172258:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612633.172259:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788612633.172261:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788612633.172262:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612633.172264:0:14359:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788612633.172284:0:14359:0:(tgt_mount.c:101:server_register_mount()) register mount ffff928e923eb800 from lustre-MDT0000 10000000:01000000:0.0:1788612633.172307:0:14359:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788612633.172310:0:14359:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788612633.172314:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff928e90d48000 10000000:01000000:0.0:1788612633.172322:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788612633.172329:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff928e90d48000 from 1 10000000:01000000:0.0:1788612633.172332:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788612633.172365:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea7bdfe00/0xfc956d548af4274c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612633.172375:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ea7bdfe00/0xfc956d548af4274c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612633.172385:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ea7bdfe00/0xfc956d548af4274c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612633.172425:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914392960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788612633.172459:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612633.181262:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612633.190364:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914392960 00000100:00100000:1.0:1788612633.190403:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914392960 00000100:00100000:1.0:1788612633.190488:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612633.190499:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+5:14359:x1875495914392960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612633.190516:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612633.190550:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b60200/0xfc956d548af42753 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af4274c expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.190589:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b60200/0xfc956d548af42753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af4274c expref: 6 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.190600:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b60200/0xfc956d548af42753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4274c expref: 6 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.190610:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60200, rc 0) 00000100:00100000:1.0:1788612633.191225:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+6:14359:x1875495914392960:12345-0@lo:101:mount.lustre.0 Request processed in 725us (18762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.191252:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612633.196121:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914392960:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612633.196163:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ea7bdfe00/0xfc956d548af4274c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42753 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612633.196178:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ea7bdfe00/0xfc956d548af4274c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af42753 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612633.196273:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914393088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612633.196333:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612633.196380:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a55000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612633.196817:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914393088 00000100:00100000:1.0:1788612633.196826:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914393088 00000100:00100000:1.0:1788612633.196914:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612633.196924:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+6:14359:x1875495914393088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612633.197282:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+6:14359:x1875495914393088:12345-0@lo:501:mount.lustre.0 Request processed in 358us (946us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788612633.197291:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612633.197553:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914393088:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788612633.197585:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788612633.197606:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea7bdfe00/0xfc956d548af4274c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42753 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612633.197617:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ea7bdfe00/0xfc956d548af4274c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42753 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612633.197628:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff928e923eb800 10000000:01000000:2.0:1788612633.197635:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788612633.197639:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff928e923eb800 10000000:01000000:2.0:1788612633.197650:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788612633.197653:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff928e923eb800 from 1 10000000:01000000:2.0:1788612633.197656:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788612633.197687:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928eacd12400/0xfc956d548af4275a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612633.197696:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928eacd12400/0xfc956d548af4275a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612633.197705:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928eacd12400/0xfc956d548af4275a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612633.197723:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914393216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788612633.197755:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612633.197789:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a55000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612633.200225:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914393216 00000100:00100000:1.0:1788612633.200242:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914393216 00000100:00100000:1.0:1788612633.200317:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612633.200328:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+6:14359:x1875495914393216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612633.200345:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612633.200369:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b60e00/0xfc956d548af42761 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af4275a expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.200397:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b60e00/0xfc956d548af42761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af4275a expref: 7 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.200410:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b60e00/0xfc956d548af42761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4275a expref: 7 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.200420:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60e00, rc 0) 00000100:00100000:1.0:1788612633.200503:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+7:14359:x1875495914393216:12345-0@lo:101:mount.lustre.0 Request processed in 176us (2747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.200509:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788612633.200693:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914393216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612633.200712:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928eacd12400/0xfc956d548af4275a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42761 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612633.200721:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928eacd12400/0xfc956d548af4275a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af42761 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612633.200740:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788612633.200809:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928eacd12400/0xfc956d548af4275a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42761 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612633.200818:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928eacd12400/0xfc956d548af4275a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42761 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612633.200825:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788612633.200883:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788612633.200888:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff928e923eb800 10000000:01000000:2.0:1788612633.200891:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788612633.200895:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788612633.200898:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788612633.200924:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928eacd12200/0xfc956d548af42768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612633.200931:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928eacd12200/0xfc956d548af42768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612633.200938:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928eacd12200/0xfc956d548af42768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612633.200955:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914393344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788612633.200989:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612633.201205:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a55000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612633.201272:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914393344 00000100:00100000:0.0:1788612633.201277:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914393344 00000100:00100000:0.0:1788612633.201316:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788612633.201324:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+7:14359:x1875495914393344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612633.201332:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612633.201343:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea7bde200/0xfc956d548af4276f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af42768 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612633.201359:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea7bde200/0xfc956d548af4276f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af42768 expref: 8 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612633.201367:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea7bde200/0xfc956d548af4276f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af42768 expref: 8 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612633.201374:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bde200, rc 0) 00000100:00100000:0.0:1788612633.201413:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+8:14359:x1875495914393344:12345-0@lo:101:mount.lustre.0 Request processed in 90us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612633.201419:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788612633.201492:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914393344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612633.201503:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928eacd12200/0xfc956d548af42768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4276f expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612633.201512:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928eacd12200/0xfc956d548af42768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4276f expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612633.201559:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914393472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612633.201585:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612633.201607:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a55000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612633.201662:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914393472 00000100:00100000:0.0:1788612633.201667:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914393472 00000100:00100000:0.0:1788612633.201707:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788612633.201714:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+8:14359:x1875495914393472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612633.202159:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+9:14359:x1875495914393472:12345-0@lo:501:mount.lustre.0 Request processed in 445us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612633.202176:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788612633.202382:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914393472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612633.202422:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914393600:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612633.202463:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612633.202494:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea7a55000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612633.202561:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914393600 00000100:00100000:1.0:1788612633.202572:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914393600 00000100:00100000:1.0:1788612633.202608:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788612633.202616:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+9:14359:x1875495914393600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612633.202945:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+9:14359:x1875495914393600:12345-0@lo:503:mount.lustre.0 Request processed in 330us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.202953:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788612633.203221:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914393600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788612633.207971:0:14395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8d85c8a-0380-4a63-8187-d0137cefd572:14395:1875495914393728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612633.208097:0:14395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612633.208138:0:14395:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91c5f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612633.208281:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914393728 00000100:00100000:1.0:1788612633.208289:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914393728 00000100:00100000:1.0:1788612633.208338:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788612633.208348:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+9:14395:x1875495914393728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612633.208946:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+9:14395:x1875495914393728:12345-0@lo:502:llog_process_th.0 Request processed in 597us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.208955:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612633.214174:0:14395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8d85c8a-0380-4a63-8187-d0137cefd572:14395:1875495914393728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788612633.214226:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612633.214239:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612633.214242:0:14395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788612633.214248:0:14395:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788612633.214252:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788612633.214268:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff928ec092cd40) 00000020:00000080:2.0:1788612633.214286:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788612633.214293:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788612633.214387:0:14395:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788612633.214397:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfc956d548af4277d 00000020:00000080:2.0:1788612633.214618:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788612633.214623:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612633.214627:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612633.214628:0:14395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788612633.214631:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612633.214635:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612633.214636:0:14395:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788612633.214639:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788612633.214647:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff928ec09299c0) 00000020:00000080:2.0:1788612633.214656:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788612633.214660:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788612633.214662:0:14395:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788612633.214665:0:14395:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788612633.214671:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788612633.215457:0:14395:0:(tgt_mount.c:153:server_get_mount()) get mount ffff928e923eb800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788612633.215474:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff928ec0928000) 00000020:00000080:2.0:1788612633.215484:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788612633.215558:0:14395:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788612633.215565:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfc956d548af42792 00000020:00000080:2.0:1788612633.215688:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788612633.215694:0:14395:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788612633.215698:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xfc956d548af42799 00080000:01000000:2.0:1788612633.215704:0:14395:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788612633.215707:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfc956d548af427a0 00010000:00010000:2.0:1788612633.326465:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788612633.328281:0:14395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788612633.328528:0:14395:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788612633.329565:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff928e98548000) 00000020:00000080:2.0:1788612633.329588:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788612633.329661:0:14395:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788612633.329668:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfc956d548af427ae 00000020:00000080:0.0:1788612633.333305:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788612633.336565:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xfc956d548af427b5 00000020:00000080:3.0:1788612633.340919:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788612633.340935:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612633.340943:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612633.340946:0:14395:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788612633.340949:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788612633.340951:0:14395:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788612633.340953:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788612633.340955:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788612633.340956:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788612633.340958:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612633.340959:0:14395:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788612633.340961:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612633.340966:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612633.340967:0:14395:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788612633.340972:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788612633.341033:0:14395:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788612633.341058:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612633.341062:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612633.341064:0:14395:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788612633.341066:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788612633.341069:0:14395:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788612633.341083:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612633.341085:0:14395:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788612633.341088:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788612633.341095:0:14395:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:3.0:1788612633.341140:0:14395:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788612633.341143:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788612633.341161:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff928e90d4b380) 00000020:00000080:3.0:1788612633.341178:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788612633.341185:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788612633.341260:0:14395:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788612633.341266:0:14395:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788612633.341273:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfc956d548af427c3 00010000:00080000:3.0:1788612633.341306:0:14395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff928ebfb4c800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:3.0:1788612633.341529:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788612633.342258:0:14395:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788612633.342304:0:14395:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788612633.350470:0:14395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788612633.353243:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788612633.353371:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788612633.356355:0:14399:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788612633.356364:0:14399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788612633.357371:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788612633.357384:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788612633.357422:0:14395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788612633.357442:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfc956d548af427ca 00000100:00080000:0.0:1788612633.357454:0:14395:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788612633.357461:0:14395:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff928ebfb4c800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1788612633.357497:0:14395:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928eacd58700 x1875495914393856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612633.357521:0:14395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788612633.357658:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914393856:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788612633.358157:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495914393856 offset 0 length 520: 4 00000020:01000000:0.0:1788612633.359897:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612633.359908:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612633.359910:0:14395:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788612633.359914:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788612633.359916:0:14395:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1788612633.359918:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788612633.359919:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788612633.359920:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788612633.359923:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612633.359924:0:14395:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788612633.359926:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788612633.359931:0:14395:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788612633.359935:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612633.359936:0:14395:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788612633.359952:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788612633.359957:0:14395:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:0.0:1788612633.359982:0:14395:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788612633.359984:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788612633.360835:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff928d858399c0) 00000020:00000080:0.0:1788612633.360888:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788612633.360897:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788612633.360977:0:14395:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788612633.360985:0:14395:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788612633.362347:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfc956d548af427d8 00010000:00080000:0.0:1788612633.362399:0:14395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff928eacf4b800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:0.0:1788612633.362631:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788612633.362887:0:14395:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788612633.362914:0:14395:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788612633.363482:0:14395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612633.363546:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788612633.363617:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788612633.372707:0:14401:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788612633.372716:0:14401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788612633.373733:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788612633.373747:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788612633.373780:0:14395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788612633.373800:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfc956d548af427df 00000100:00080000:3.0:1788612633.373811:0:14395:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788612633.373818:0:14395:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff928eacf4b800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1788612633.373890:0:14395:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928eb7fcf480 x1875495914393984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612633.373923:0:14395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788612633.373974:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612633.373978:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612633.373981:0:14395:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788612633.373984:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612633.373988:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612633.373990:0:14395:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788612633.374137:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788612633.374139:0:14395:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788612633.374142:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612633.374144:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612633.374146:0:14395:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788612633.374148:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612633.374151:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612633.374152:0:14395:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788612633.374156:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788612633.374190:0:14395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8d85c8a-0380-4a63-8187-d0137cefd572:14395:1875495914394112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612633.374276:0:14395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612633.374314:0:14395:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90c90cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612633.374425:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914394112 00000100:00100000:1.0:1788612633.374433:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914394112 00000100:00100000:1.0:1788612633.374472:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612633.374481:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+9:14395:x1875495914394112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788612633.374729:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+9:14395:x1875495914394112:12345-0@lo:502:llog_process_th.0 Request processed in 248us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.374738:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788612633.374888:0:14395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8d85c8a-0380-4a63-8187-d0137cefd572:14395:1875495914394112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612633.374913:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612633.374918:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612633.374920:0:14395:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788612633.374923:0:14395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:0.0:1788612633.375114:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914393984:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788612633.375146:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495914393984 offset 0 length 520: 4 00000020:01000000:1.0:1788612633.375500:0:14359:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788612633.375521:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788612633.375550:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928eacd12200/0xfc956d548af42768 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4276f expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.375562:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928eacd12200/0xfc956d548af42768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4276f expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612633.375582:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff928e923eb800 from 1 10000000:01000000:1.0:1788612633.375585:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788612633.375612:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.375620:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.375629:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612633.375643:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914394240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612633.375685:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612633.375707:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e81254780 going to sleep for 11 seconds 00000100:00100000:2.0:1788612633.375917:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914394240 00000100:00100000:2.0:1788612633.375924:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914394240 00000100:00100000:2.0:1788612633.375957:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612633.375965:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+9:14359:x1875495914394240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612633.375974:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612633.375991:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928eacd13400/0xfc956d548af427ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af427e6 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612633.376027:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928eacd13400/0xfc956d548af427ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af427e6 expref: 10 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612633.376045:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928eacd13400/0xfc956d548af427ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af427e6 expref: 10 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612633.376053:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd13400, rc 0) 00000100:00100000:2.0:1788612633.376108:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+10:14359:x1875495914394240:12345-0@lo:101:mount.lustre.0 Request processed in 143us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612633.376115:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612633.376259:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914394240:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612633.376273:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af427ed expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612633.376283:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af427ed expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612633.376986:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914394368:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788612633.377377:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612633.377417:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612633.377552:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914394368 00000100:00100000:1.0:1788612633.377559:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914394368 00000100:00100000:1.0:1788612633.377603:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788612633.377612:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+10:14359:x1875495914394368:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788612633.377630:0:14372:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788612633.377636:0:14372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788612633.377929:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+10:14359:x1875495914394368:12345-0@lo:256:mount.lustre.0 Request processed in 318us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.377938:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612633.378189:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914394368:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788612633.378922:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788612633.378940:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af427ed expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612633.378952:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af427ed expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612633.378960:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928e923eb800 from 1 10000000:01000000:0.0:1788612633.378963:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612633.379477:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612633.379489:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612633.379499:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612633.379522:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914394496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788612633.379591:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612633.379628:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612633.379735:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914394496 00000100:00100000:1.0:1788612633.379742:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914394496 00000100:00100000:1.0:1788612633.379793:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612633.379802:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+10:14359:x1875495914394496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612633.379829:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612633.379870:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b61200/0xfc956d548af427fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af427f4 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.379894:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b61200/0xfc956d548af427fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af427f4 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.379905:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b61200/0xfc956d548af427fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af427f4 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.379914:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61200, rc 0) 00000100:00100000:1.0:1788612633.379951:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+11:14359:x1875495914394496:12345-0@lo:101:mount.lustre.0 Request processed in 150us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.379958:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612633.380049:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914394496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612633.380064:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af427fb expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612633.380096:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af427fb expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612633.380161:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914394624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612633.380188:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612633.380217:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612633.380532:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914394624 00000100:00100000:1.0:1788612633.380537:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914394624 00000100:00100000:1.0:1788612633.380586:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612633.380594:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+11:14359:x1875495914394624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612633.381192:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+11:14359:x1875495914394624:12345-0@lo:501:mount.lustre.0 Request processed in 597us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.381201:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788612633.382015:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914394624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612633.382085:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914394752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788612633.382145:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612633.382181:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612633.382637:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914394752 00000100:00100000:3.0:1788612633.382644:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914394752 00000100:00100000:3.0:1788612633.382707:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788612633.382716:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+11:14359:x1875495914394752:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612633.382911:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+11:14359:x1875495914394752:12345-0@lo:503:mount.lustre.0 Request processed in 195us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612633.382919:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788612633.383244:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914394752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788612633.388167:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8d85c8a-0380-4a63-8187-d0137cefd572:14403:1875495914394880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612633.388268:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612633.388345:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612633.388805:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914394880 00000100:00100000:3.0:1788612633.388814:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914394880 00000100:00100000:3.0:1788612633.388905:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788612633.388916:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+11:14403:x1875495914394880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612633.389219:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+11:14403:x1875495914394880:12345-0@lo:502:llog_process_th.0 Request processed in 303us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612633.389233:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612633.389416:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8d85c8a-0380-4a63-8187-d0137cefd572:14403:1875495914394880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788612633.389449:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612633.389458:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612633.389461:0:14403:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788612633.389468:0:14403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff928e923eb800 00000020:00000080:0.0:1788612633.389471:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788612633.389478:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612633.389480:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612633.389481:0:14403:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788612633.389484:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612633.389486:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612633.389492:0:14403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788612633.389496:0:14403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff928e923eb800 00000020:00000080:0.0:1788612633.389498:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788612633.389568:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612633.389572:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612633.389573:0:14403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788612633.389576:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612633.389579:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612633.389580:0:14403:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788612633.389584:0:14403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff928e923eb800 00000020:00000080:0.0:1788612633.389586:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788612633.389628:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8d85c8a-0380-4a63-8187-d0137cefd572:14403:1875495914395008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612633.389667:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612633.389709:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612633.391915:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914395008 00000100:00100000:3.0:1788612633.391927:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914395008 00000100:00100000:3.0:1788612633.391980:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788612633.392001:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+11:14403:x1875495914395008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612633.392256:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+11:14403:x1875495914395008:12345-0@lo:502:llog_process_th.0 Request processed in 268us (2588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612633.392264:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788612633.392327:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8d85c8a-0380-4a63-8187-d0137cefd572:14403:1875495914395008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612633.392360:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612633.392367:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612633.392369:0:14403:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788612633.392374:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788612633.397187:0:14359:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788612633.397229:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788612633.397251:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af427fb expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.397264:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af427fb expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612633.397327:0:14359:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788612633.397330:0:14359:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff928e923eb800 10000000:01000000:1.0:1788612633.397334:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff928e923eb800 10000000:01000000:1.0:1788612633.397338:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788612633.397344:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff928e923eb800 from 1 10000000:01000000:1.0:1788612633.397347:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788612633.397385:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b60600/0xfc956d548af42802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.397394:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b60600/0xfc956d548af42802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.397405:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b60600/0xfc956d548af42802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612633.397432:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914395136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612633.397501:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612633.397563:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90aae840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612633.397587:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914395136 00000100:00100000:1.0:1788612633.397593:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914395136 00000100:00100000:1.0:1788612633.397633:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788612633.397643:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+11:14359:x1875495914395136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612633.397656:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612633.397669:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b60400/0xfc956d548af42809 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af42802 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.397705:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b60400/0xfc956d548af42809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af42802 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.397727:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b60400/0xfc956d548af42809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af42802 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.397736:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60400, rc 0) 00000100:00100000:1.0:1788612633.397774:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14359:x1875495914395136:12345-0@lo:101:mount.lustre.0 Request processed in 132us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.397781:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788612633.397827:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914395136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612633.397865:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b60600/0xfc956d548af42802 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42809 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.397876:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b60600/0xfc956d548af42802 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af42809 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612633.397921:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914395264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612633.397946:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612633.397964:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90aae840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612633.397977:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914395264 00000100:00100000:1.0:1788612633.397980:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914395264 00000100:00100000:1.0:1788612633.398765:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788612633.398779:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14359:x1875495914395264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612633.399168:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14359:x1875495914395264:12345-0@lo:501:mount.lustre.0 Request processed in 392us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.399176:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788612633.399225:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914395264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612633.399275:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914395392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612633.399313:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612633.399338:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90aae840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612633.399351:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914395392 00000100:00100000:1.0:1788612633.399357:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914395392 00000100:00100000:1.0:1788612633.399379:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612633.399384:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14359:x1875495914395392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612633.399525:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14359:x1875495914395392:12345-0@lo:503:mount.lustre.0 Request processed in 140us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.399532:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612633.400106:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914395392:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612633.402358:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8d85c8a-0380-4a63-8187-d0137cefd572:14406:1875495914395520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612633.402437:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612633.402479:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914395520 00000100:00100000:3.0:1788612633.402486:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914395520 00000100:00100000:3.0:1788612633.402554:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788612633.402565:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14406:x1875495914395520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612633.403531:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14406:x1875495914395520:12345-0@lo:502:llog_process_th.0 Request processed in 964us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612633.403908:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e910e4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612633.403934:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8d85c8a-0380-4a63-8187-d0137cefd572:14406:1875495914395520:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788612633.404018:0:14406:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788612633.404034:0:14406:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff928e9854b380) 00000020:00000080:2.0:1788612633.404053:0:14406:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788612633.404147:0:14406:0:(tgt_mount.c:153:server_get_mount()) get mount ffff928e923eb800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788612633.404151:0:14406:0:(tgt_mount.c:187:server_put_mount()) put mount ffff928e923eb800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788612633.404154:0:14406:0:(obd_mount.c:710:lustre_put_lsi()) put ffff928e923eb800 4 00010000:00080000:2.0:1788612633.404183:0:14406:0:(ldlm_lib.c:102:import_set_conn()) imp ffff928e82dc9000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.106@tcp at head 00000100:00100000:3.0:1788612633.405129:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1788612633.413908:0:14406:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788612633.416159:0:14406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788612633.416197:0:14406:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788612633.416212:0:14406:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xfc956d548af42817 00000100:00080000:2.0:1788612633.416223:0:14406:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612633.416229:0:14406:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff928e82dc9000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1788612633.416267:0:14406:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928d8792d880 x1875495914395648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788612633.416322:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875495914395648:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788612633.416405:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788612633.416469:0:14406:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788612633.416692:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914395648 00000100:00100000:0.0:1788612633.416700:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914395648 00000100:00100000:0.0:1788612633.416730:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612633.416737:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875495914395648:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788612633.416789:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875495914395648:12345-0@lo:38:llog_process_th.0 Request processed in 52us (383us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788612633.416796:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612633.418741:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788612633.418755:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928e82dc9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612633.418762:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788612633.418766:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875495914395648:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788612633.422290:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8d85c8a-0380-4a63-8187-d0137cefd572:14406:1875495914395776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612633.422377:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612633.422420:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914395776 00000100:00100000:2.0:1788612633.422428:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914395776 00000100:00100000:2.0:1788612633.422479:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788612633.422487:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14406:x1875495914395776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612633.424778:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14406:x1875495914395776:12345-0@lo:502:llog_process_th.0 Request processed in 2282us (2392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612633.424791:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788612633.424877:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eacf91e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612633.424900:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8d85c8a-0380-4a63-8187-d0137cefd572:14406:1875495914395776:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788612633.424935:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788612633.430891:0:14359:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788612633.430927:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788612633.430945:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b60600/0xfc956d548af42802 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42809 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.430957:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b60600/0xfc956d548af42802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42809 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788612633.431027:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788612633.431030:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788612633.431031:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612633.431032:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612633.431033:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612633.431034:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612633.431035:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788612633.431037:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788612633.431039:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612633.431040:0:14359:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788612633.431045:0:14359:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788612633.431053:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788612633.431054:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788612633.431055:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612633.431056:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612633.431057:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612633.431058:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612633.431059:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788612633.431060:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788612633.431061:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612633.431062:0:14359:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788612633.431101:0:14359:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788612633.431122:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914395904:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788612633.431194:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612633.431245:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90aae600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612633.435249:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914395904 00000100:00100000:0.0:1788612633.435269:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914395904 00000100:00100000:0.0:1788612633.435362:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788612633.435374:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14359:x1875495914395904:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788612633.435426:0:14371:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788612633.435441:0:14371:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788612633.491432:0:14371:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788612633.491447:0:14371:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788612633.491490:0:14393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788612633.491495:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788612633.491518:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.491539:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928eacd13400/0xfc956d548af427ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af427e6 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.491549:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.491589:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928eacd13400/0xfc956d548af427ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af427e6 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.491604:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928eacd13400/0xfc956d548af427ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af427e6 expref: 12 pid: 14371 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612633.491618:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1875495914396032:0@lo:104: 00000100:00100000:1.0:1788612633.491710:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612633.491750:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90aae180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612633.491788:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396032 00000100:00100000:1.0:1788612633.491795:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396032 00000100:00100000:1.0:1788612633.491866:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612633.491876:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8d85c8a-0380-4a63-8187-d0137cefd572+3:14393:x1875495914396032:12345-0@lo:104: 00010000:00010000:1.0:1788612633.491888:0:14360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af427ed expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612633.491936:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788612633.491942:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8d85c8a-0380-4a63-8187-d0137cefd572+3:14393:x1875495914396032:12345-0@lo:104: Request processed in 68us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612633.491949:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612633.491984:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1875495914396032:0@lo:104: 00010000:00010000:1.0:1788612633.492123:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.492479:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612633.492486:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af427ed expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.492508:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60800 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788612633.492512:0:14366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af427ed expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.492521:0:14366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af427ed expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612633.492529:0:14366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af427ed expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612633.492533:0:14366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612633.492566:0:14366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af427ed expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.492572:0:14366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612633.492589:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af427ed expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.492596:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af427e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af427ed expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.492612:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612633.492613:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612633.492615:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612633.492637:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8d85c8a-0380-4a63-8187-d0137cefd572:3308:1875495914396160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612633.492718:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612633.492782:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396160 00000100:00100000:3.0:1788612633.492787:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396160 00010000:00010000:3.0:1788612633.492806:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928eacd13400/0xfc956d548af427ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af427e6 expref: 13 pid: 14371 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612633.492856:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612633.492865:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8d85c8a-0380-4a63-8187-d0137cefd572+13:3308:x1875495914396160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612633.492890:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612633.492897:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928eacd13400/0xfc956d548af427ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af427e6 expref: 13 pid: 14371 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.492908:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928eacd13400/0xfc956d548af427ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af427e6 expref: 13 pid: 14371 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.492922:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928eacd13400/0xfc956d548af427ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af427e6 expref: 13 pid: 14371 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.492937:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.492946:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788612633.492959:0:14362:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001464833s 00010000:00010000:3.0:1788612633.492964:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.492970:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.492976:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.492982:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.493110:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612633.493116:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.493124:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.493139:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.493150:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612633.493184:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8d85c8a-0380-4a63-8187-d0137cefd572+12:3308:x1875495914396160:12345-0@lo:103:ldlm_bl.0 Request processed in 320us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612633.493191:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612633.493226:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8d85c8a-0380-4a63-8187-d0137cefd572:3308:1875495914396160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612633.493246:0:14393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.493254:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612633.493260:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b61400/0xfc956d548af4281e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612633.502793:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+11:14359:x1875495914395904:12345-0@lo:253:mount.lustre.0 Request processed in 67410us (71586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612633.502812:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788612633.503111:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:14359:1875495914395904:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788612633.503129:0:14359:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788612633.503132:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788612633.503134:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788612633.503136:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612633.503137:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612633.503138:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612633.503139:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612633.503140:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788612633.503142:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788612633.503144:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612633.503145:0:14359:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788612633.503163:0:14359:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788612633.510457:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788612633.510616:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788612633.510925:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788612633.511388:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788612633.511961:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788612633.512242:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788612633.514398:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788612633.514582:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788612633.514901:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788612633.515141:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788612633.515404:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788612633.515550:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788612633.570423:0:14359:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788612633.570750:0:14359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788612633.570762:0:14415:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788612633.570766:0:14415:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788612633.571303:0:14416:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788612633.571381:0:14416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612633.574171:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:01000000:3.0:1788612633.574212:0:14359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000004:00080000:1.0:1788612633.574244:0:14416:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788612633.574248:0:14416:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1788612633.574327:0:14359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788612633.575826:0:14359:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788612633.575886:0:14359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788612633.576480:0:14359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788612633.578336:0:14359:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788612633.579255:0:14359:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788612633.579297:0:14359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788612633.582035:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788612633.592616:0:14359:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788612633.646449:0:14359:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788612633.646485:0:14359:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa37a01717988 00100000:10000000:2.0:1788612633.646493:0:14359:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788612633.650324:0:14359:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788612633.650346:0:14359:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788612633.650369:0:14359:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788612633.650390:0:14359:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788612634.028210:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788612634.411914:0:14374:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788612634.411922:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff928e923eb800 from 6 10000000:01000000:1.0:1788612634.411934:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788612634.411980:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612634.411991:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612634.412003:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612634.412042:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914396288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788612634.412124:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612634.412176:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612634.413513:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396288 00000100:00100000:0.0:1788612634.413526:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396288 00000100:00100000:0.0:1788612634.413591:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788612634.413610:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+11:14374:x1875495914396288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612634.413625:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612634.413643:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea7bdec00/0xfc956d548af4282c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af42825 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612634.413684:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea7bdec00/0xfc956d548af4282c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af42825 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612634.413694:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea7bdec00/0xfc956d548af4282c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af42825 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612634.413703:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdec00, rc 0) 00000100:00100000:0.0:1788612634.413776:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14374:x1875495914396288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612634.413783:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788612634.415279:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914396288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612634.415305:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4282c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612634.415316:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4282c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612634.415394:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914396416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788612634.415449:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612634.415525:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612634.415578:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396416 00000100:00100000:2.0:1788612634.415584:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396416 00000100:00100000:2.0:1788612634.415630:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612634.415640:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14374:x1875495914396416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788612634.415662:0:14371:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788612634.415747:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788612634.415751:0:14371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788612634.416617:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14374:x1875495914396416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 976us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612634.416625:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788612634.417254:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914396416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788612634.417313:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788612634.417322:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4282c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612634.417331:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4282c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612634.481495:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788612635.051940:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788612635.501244:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788612636.076242:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612637.099993:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788612637.783747:0:14658:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788612638.133401:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788612638.767288:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612638.767295:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612638.767299:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612638.767302:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612638.767304:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788612638.767307:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788612638.767310:0:8:0:(import.c:65:import_set_state_nolock()) ffff928e82dc9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612638.767323:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff928e82dc9000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1788612638.767343:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928eb7fcca80 x1875495914396672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788612638.767392:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8d85c8a-0380-4a63-8187-d0137cefd572:3305:1875495914396544:0@lo:400:kworker.0 00000100:00100000:3.0:1788612638.767456:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612638.767531:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396544 00000100:00100000:3.0:1788612638.767538:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396544 00000100:00100000:3.0:1788612638.767601:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788612638.767611:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+12:3305:x1875495914396544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612638.767671:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+12:3305:x1875495914396544:12345-0@lo:400:kworker.0 Request processed in 62us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612638.767687:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788612638.767751:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8d85c8a-0380-4a63-8187-d0137cefd572:3305:1875495914396544:0@lo:400:kworker.0 00000100:00100000:0.0:1788612638.768120:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875495914396672:0@lo:38:kworker.0 00000100:00100000:0.0:1788612638.768156:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612638.768191:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396672 00000100:00100000:0.0:1788612638.768195:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396672 00000100:00100000:0.0:1788612638.768230:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612638.768235:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875495914396672:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788612638.768255:0:14379:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:0.0:1788612638.768288:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xfc956d548af42833 00000004:00100000:0.0:1788612638.768301:0:14379:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788612638.768429:0:14379:0:(import.c:65:import_set_state_nolock()) ffff928d8505d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612638.768467:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875495914396672:12345-0@lo:38:kworker.0 Request processed in 231us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612638.768474:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788612638.768505:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff928eb7fcca80 x1875495914396672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788612638.768519:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788612638.768526:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788612638.768530:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788612638.768532:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928e82dc9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788612638.768537:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875495914396672:0@lo:38:kworker.0 00010000:00010000:3.0:1788612639.159947:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612640.174768:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788612641.050075:0:14809:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee5d488a0 20000000:00000080:2.0:1788612641.050095:0:14809:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff928e987aa000 uarg=0000000000000000 20000000:01000000:2.0:1788612641.050127:0:14809:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788612641.050134:0:14809:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788612641.050139:0:14809:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788612641.052193:0:14810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788612641.052862:0:14809:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788612641.068365:0:14809:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788612641.068578:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612641.068611:0:14809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928e90b61200/0xfc956d548af427fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af427f4 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612641.068620:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612641.068667:0:14809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928e90b61200/0xfc956d548af427fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af427f4 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612641.068682:0:14809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928e90b61200/0xfc956d548af427fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af427f4 expref: 11 pid: 14370 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612641.068698:0:14809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14809:1875495914396800:0@lo:104: 00000100:00100000:1.0:1788612641.068778:0:14809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612641.068833:0:14809:0:(client.c:2716:ptlrpc_set_wait()) set ffff928eb5b72540 going to sleep for 11 seconds 00000100:00100000:2.0:1788612641.068947:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396800 00000100:00100000:2.0:1788612641.068965:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396800 00000100:00100000:2.0:1788612641.069010:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788612641.069020:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8d85c8a-0380-4a63-8187-d0137cefd572+3:14809:x1875495914396800:12345-0@lo:104: 00010000:00010000:2.0:1788612641.069033:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af427fb expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069096:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612641.069102:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8d85c8a-0380-4a63-8187-d0137cefd572+3:14809:x1875495914396800:12345-0@lo:104: Request processed in 84us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612641.069109:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788612641.069148:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612641.069155:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af427fb expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069163:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf600 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612641.069166:0:14366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af427fb expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069175:0:14366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af427fb expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612641.069182:0:14366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af427fb expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612641.069187:0:14366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788612641.069216:0:14366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af427fb expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069223:0:14366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612641.069247:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af427fb expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069254:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928ea7bdf600/0xfc956d548af427f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af427fb expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069269:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612641.069271:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612641.069272:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612641.069298:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8d85c8a-0380-4a63-8187-d0137cefd572:3306:1875495914396928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612641.069328:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612641.069383:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914396928 00000100:00100000:2.0:1788612641.069387:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914396928 00010000:00010000:2.0:1788612641.069404:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928e90b61200/0xfc956d548af427fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af427f4 expref: 12 pid: 14370 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612641.069424:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788612641.069431:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8d85c8a-0380-4a63-8187-d0137cefd572+12:3306:x1875495914396928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612641.069442:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612641.069447:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928e90b61200/0xfc956d548af427fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af427f4 expref: 12 pid: 14370 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069457:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928e90b61200/0xfc956d548af427fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af427f4 expref: 12 pid: 14370 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069475:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069483:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069496:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069504:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069511:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069518:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069536:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60c00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612641.069541:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069549:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069557:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612641.069568:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612641.069594:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8d85c8a-0380-4a63-8187-d0137cefd572+12:3306:x1875495914396928:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612641.069601:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788612641.069633:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8d85c8a-0380-4a63-8187-d0137cefd572:3306:1875495914396928:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612641.069796:0:14809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b61200/0xfc956d548af427fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af427f4 expref: 11 pid: 14370 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612641.069809:0:14809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14809:1875495914396800:0@lo:104: 00010000:00010000:1.0:1788612641.069822:0:14809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612641.069831:0:14809:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612641.069868:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612641.069874:0:14809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928e90b60c00/0xfc956d548af4283a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612641.199082:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612642.220976:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788612642.426394:0:14374:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788612642.426402:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928e923eb800 from 10 10000000:01000000:1.0:1788612642.426407:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788612642.426456:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612642.426468:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612642.426479:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612642.426504:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914397056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788612642.426569:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612642.426625:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e988f4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612642.426711:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914397056 00000100:00100000:2.0:1788612642.426720:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914397056 00000100:00100000:2.0:1788612642.426777:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788612642.426787:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+11:14374:x1875495914397056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612642.426799:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612642.426813:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928eacd12e00/0xfc956d548af42848 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af42841 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612642.426872:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928eacd12e00/0xfc956d548af42848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af42841 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612642.426883:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928eacd12e00/0xfc956d548af42848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af42841 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612642.426907:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd12e00, rc 0) 00000100:00100000:2.0:1788612642.426943:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14374:x1875495914397056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612642.426951:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788612642.427163:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914397056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612642.427179:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42848 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612642.427188:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af42848 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612642.427244:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914397184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612642.427270:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612642.427297:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e988f4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612642.427445:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914397184 00000100:00100000:2.0:1788612642.427449:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914397184 00000100:00100000:2.0:1788612642.427478:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788612642.427485:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14374:x1875495914397184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612642.427736:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14374:x1875495914397184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612642.427742:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612642.427879:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914397184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612642.427908:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914397312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612642.427944:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612642.427967:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec0357240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612642.428606:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914397312 00000100:00100000:2.0:1788612642.428611:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914397312 00000100:00100000:2.0:1788612642.428657:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788612642.428664:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14374:x1875495914397312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612642.428819:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+12:14374:x1875495914397312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612642.428826:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612642.429004:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914397312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788612642.429698:0:14863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788612642.429760:0:14374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788612642.429782:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612642.429792:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42848 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612642.429802:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42848 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612643.244122:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788612643.884613:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612643.884628:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612643.884631:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612643.884634:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788612643.884664:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8d85c8a-0380-4a63-8187-d0137cefd572:3307:1875495914397440:0@lo:400:kworker.0 00000100:00100000:0.0:1788612643.884725:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612643.884769:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612643.884774:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914397568:0@lo:400:kworker.0 00000100:00100000:0.0:1788612643.884795:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612643.884822:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914397440 00000100:00100000:0.0:1788612643.884828:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914397440 00000100:00100000:0.0:1788612643.884889:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788612643.884897:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+12:3307:x1875495914397440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612643.884940:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+12:3307:x1875495914397440:12345-0@lo:400:kworker.0 Request processed in 43us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612643.884947:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788612643.884981:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914397568 00000100:00100000:0.0:1788612643.884984:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914397568 00000100:00100000:0.0:1788612643.885003:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612643.885008:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914397568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612643.885051:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914397568:12345-0@lo:400:kworker.0 Request processed in 42us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612643.885057:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788612643.885104:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff928eacd59880 x1875495914397568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612643.885119:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914397568:0@lo:400:kworker.0 00000100:00100000:0.0:1788612643.885127:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8d85c8a-0380-4a63-8187-d0137cefd572:3307:1875495914397440:0@lo:400:kworker.0 00000100:00100000:1.0:1788612643.888742:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612633/real 1788612633] req@ffff928eb7fcf480 x1875495914393984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612643 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612643.888785:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff928eb7fcf480 x1875495914393984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612643 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612643.888810:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612633/real 1788612633] req@ffff928eacd58700 x1875495914393856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612643 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612643.888822:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff928eacd58700 x1875495914393856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612643 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788612643.888910:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928eacf4b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612643.888960:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788612643.888965:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914393984:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788612643.888972:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928ebfb4c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788612643.888996:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612643.889001:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788612643.889004:0:38:0:(import.c:65:import_set_state_nolock()) ffff928ebfb4c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612643.889009:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 427 00000100:00080000:3.0:1788612643.889014:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788612643.889030:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff928ebfb4c800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1788612643.889065:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928eb7fcc700 x1875495914397696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612643.889078:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612643.889080:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788612643.889082:0:38:0:(import.c:65:import_set_state_nolock()) ffff928eacf4b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612643.889084:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 427 00000100:00080000:3.0:1788612643.889087:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788612643.889090:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff928eacf4b800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1788612643.889099:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928eb7fcea00 x1875495914397824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612643.889172:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788612643.889176:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914393856:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788612643.889203:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914397696:0@lo:8:kworker.0 00000400:00000100:1.0:1788612643.889252:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495914397696 offset 0 length 520: 4 00000100:00100000:1.0:1788612643.889284:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914397824:0@lo:8:kworker.0 00000400:00000100:1.0:1788612643.889304:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495914397824 offset 0 length 520: 4 00010000:00010000:2.0:1788612644.269176:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612645.292053:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788612645.751242:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1788612645.852514:0:15058:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788612645.852518:0:15058:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788612645.852819:0:15058:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff928ec00ff000 00000020:01000004:1.0:1788612645.852855:0:15058:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788612645.852868:0:15058:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788612645.852884:0:15058:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff928e91144d40) 00000020:00000080:1.0:1788612645.852904:0:15058:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788612645.957386:0:15058:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788612645.960444:0:15058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788612645.962392:0:15058:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788612645.963412:0:15058:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788612645.963681:0:15058:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788612645.969934:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788612645.970408:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788612645.970592:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788612645.971396:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 382: rc = 0 00100000:10000000:2.0:1788612645.971922:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 382: rc = 0 00100000:10000000:2.0:1788612645.972554:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 382: rc = 0 00100000:10000000:2.0:1788612645.973105:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 382: rc = 0 00100000:10000000:2.0:1788612645.973359:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 382: rc = 0 00100000:10000000:2.0:1788612645.973679:0:15058:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 382: rc = 0 00000020:00000080:2.0:1788612645.974672:0:15058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788612645.974685:0:15058:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788612645.974696:0:15058:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfc956d548af42856 00000020:01000004:2.0:1788612645.974705:0:15058:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788612645.974819:0:15058:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788612645.974824:0:15058:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788612645.974832:0:15058:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788612645.974867:0:15058:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788612645.974880:0:15058:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff928e9854cd40) 00000020:00000080:2.0:1788612645.974890:0:15058:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788612645.978953:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612645.979382:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788612645.979388:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788612645.994085:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788612645.994100:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788612645.996245:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788612645.996261:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788612646.000441:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612646.000640:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788612646.000647:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788612646.004594:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788612646.004608:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788612646.052530:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612646.052770:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788612646.052777:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788612646.055039:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788612646.055054:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788612646.055944:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788612646.055954:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788612646.063737:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612646.063956:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788612646.063962:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788612646.066249:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788612646.066263:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788612646.128507:0:15058:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612646.128711:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788612646.128718:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788612646.129825:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788612646.129833:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788612646.130505:0:15058:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788612646.130529:0:15058:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788612646.130535:0:15058:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788612646.148472:0:15058:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788612646.148510:0:15058:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788612646.148515:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788612646.148517:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788612646.148519:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612646.148520:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612646.148521:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612646.148522:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612646.148524:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788612646.148526:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612646.148527:0:15058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788612646.148531:0:15058:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788612646.148533:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788612646.148535:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788612646.148536:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612646.148537:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612646.148538:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612646.148539:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612646.148540:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788612646.148542:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612646.148543:0:15058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788612646.148571:0:15058:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788612646.148599:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914397952:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788612646.148683:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612646.148745:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90b63900 going to sleep for 11 seconds 00000100:00100000:1.0:1788612646.148833:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914397952 00000100:00100000:1.0:1788612646.149051:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914397952 00000100:00100000:1.0:1788612646.149097:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788612646.149106:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+12:15058:x1875495914397952:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788612646.149145:0:14371:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788612646.149149:0:14371:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788612646.149153:0:14371:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788612646.166200:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+12:15058:x1875495914397952:12345-0@lo:253:mount.lustre.0 Request processed in 17086us (17508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612646.166216:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788612646.166429:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914397952:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788612646.166444:0:15058:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788612646.166447:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788612646.166449:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612646.166450:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612646.166451:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612646.166453:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612646.166454:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612646.166455:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612646.166457:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612646.166459:0:15058:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788612646.166479:0:15058:0:(tgt_mount.c:101:server_register_mount()) register mount ffff928ec00ff000 from lustre-OST0000 10000000:01000000:0.0:1788612646.166503:0:15058:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788612646.166506:0:15058:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788612646.166512:0:15058:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff928e90d48000 local copy 00010000:00010000:0.0:1788612646.166522:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea7bdfe00/0xfc956d548af4274c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42753 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612646.167026:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612646.167339:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.167405:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e82aef600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612646.167440:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914398080 00000100:00100000:0.0:1788612646.167445:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914398080 00000100:00100000:0.0:1788612646.167531:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788612646.167540:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+12:15058:x1875495914398080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612646.167705:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+12:15058:x1875495914398080:12345-0@lo:501:mount.lustre.0 Request processed in 165us (366us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788612646.167719:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788612646.167789:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398080:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788612646.167803:0:15058:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788612646.167976:0:15058:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788612646.167983:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea7bdfe00/0xfc956d548af4274c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42753 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.167993:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ea7bdfe00/0xfc956d548af4274c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42753 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612646.168026:0:15058:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff928ec00ff000 10000000:01000000:1.0:1788612646.168032:0:15058:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788612646.168037:0:15058:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff928e90d48000 10000000:01000000:1.0:1788612646.168039:0:15058:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788612646.168042:0:15058:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff928e90d48000 from 1 10000000:01000000:1.0:1788612646.168049:0:15058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788612646.168073:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b60c00/0xfc956d548af42864 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.168082:0:15058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b60c00/0xfc956d548af42864 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.168091:0:15058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b60c00/0xfc956d548af42864 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612646.168104:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612646.168128:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.168548:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612646.168677:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914398208 00000100:00100000:2.0:1788612646.168683:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914398208 00000100:00100000:2.0:1788612646.168716:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788612646.168723:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+12:15058:x1875495914398208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612646.168741:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612646.168755:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928eacd13c00/0xfc956d548af4286b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af42864 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612646.168777:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928eacd13c00/0xfc956d548af4286b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af42864 expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612646.168788:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928eacd13c00/0xfc956d548af4286b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af42864 expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612646.168796:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd13c00, rc 0) 00000100:00100000:2.0:1788612646.168855:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+13:15058:x1875495914398208:12345-0@lo:101:mount.lustre.0 Request processed in 114us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612646.168861:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612646.169057:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612646.169071:0:15058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b60c00/0xfc956d548af42864 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4286b expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.169079:0:15058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b60c00/0xfc956d548af42864 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af4286b expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612646.169096:0:15058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788612646.169104:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b60c00/0xfc956d548af42864 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4286b expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.169111:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b60c00/0xfc956d548af42864 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af4286b expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612646.169117:0:15058:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788612646.169121:0:15058:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788612646.169132:0:15058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788612646.169134:0:15058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788612646.169151:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af42872 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.169158:0:15058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af42872 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.169165:0:15058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af42872 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612646.169180:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612646.169208:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.169225:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612646.169339:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914398336 00000100:00100000:2.0:1788612646.169344:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914398336 00000100:00100000:2.0:1788612646.169363:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788612646.169369:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+13:15058:x1875495914398336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612646.169376:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612646.169384:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928eacd13400/0xfc956d548af42879 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af42872 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612646.169398:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928eacd13400/0xfc956d548af42879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af42872 expref: 14 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612646.169406:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928eacd13400/0xfc956d548af42879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af42872 expref: 14 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612646.169424:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd13400, rc 0) 00000100:00100000:2.0:1788612646.169459:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+14:15058:x1875495914398336:12345-0@lo:101:mount.lustre.0 Request processed in 89us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612646.169465:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612646.169531:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612646.169541:0:15058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af42872 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42879 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.169549:0:15058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af42872 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af42879 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612646.170448:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788612646.179131:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612646.179435:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788612646.179480:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788612646.179516:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788612646.179563:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788612646.179599:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788612646.179633:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788612646.179696:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788612646.179711:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788612646.179804:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612646.179899:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.179948:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612646.180229:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914398464 00000100:00100000:2.0:1788612646.180237:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914398464 00000100:00100000:2.0:1788612646.180275:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788612646.180284:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+14:15058:x1875495914398464:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612646.180605:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+14:15058:x1875495914398464:12345-0@lo:501:mount.lustre.0 Request processed in 321us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612646.182044:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788612646.185333:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612646.185396:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398592:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612646.185478:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.185521:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612646.185648:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914398592 00000100:00100000:2.0:1788612646.185655:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914398592 00000100:00100000:2.0:1788612646.185709:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788612646.185719:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+14:15058:x1875495914398592:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612646.191920:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+14:15058:x1875495914398592:12345-0@lo:503:mount.lustre.0 Request processed in 6193us (6433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612646.191934:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612646.192486:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398592:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788612646.193135:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788612646.193209:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398720:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612646.193996:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.194117:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612646.194350:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914398720 00000100:00100000:3.0:1788612646.194357:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914398720 00000100:00100000:0.0:1788612646.197550:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788612646.197643:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+14:15058:x1875495914398720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612646.197981:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+14:15058:x1875495914398720:12345-0@lo:502:mount.lustre.0 Request processed in 418us (3984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612646.197989:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788612646.198133:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398720:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612646.198401:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788612646.198454:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788612646.198501:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788612646.198546:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788612646.198582:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788612646.198612:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788612646.198653:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788612646.198685:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788612646.198714:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788612646.198763:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788612646.198795:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788612646.198832:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788612646.198909:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612646.198961:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.198990:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612646.199184:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914398848 00000100:00100000:0.0:1788612646.199191:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914398848 00000100:00100000:0.0:1788612646.199243:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788612646.199251:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+14:15058:x1875495914398848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612646.199403:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+14:15058:x1875495914398848:12345-0@lo:502:mount.lustre.0 Request processed in 152us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612646.199411:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788612646.199692:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612646.199764:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788612646.199773:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788612646.201061:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788612646.201168:0:15072:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788612646.201177:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612646.201179:0:15072:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788612646.201185:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788612646.201199:0:15072:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff928e91140000) 00000020:00000080:1.0:1788612646.201224:0:15072:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788612646.201230:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788612646.201371:0:15072:0:(tgt_mount.c:153:server_get_mount()) get mount ffff928ec00ff000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788612646.201378:0:15072:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788612646.201385:0:15072:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfc956d548af42887 00010000:00010000:2.0:1788612646.215121:0:15072:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788612646.215561:0:15072:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788612646.222407:0:15072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788612646.225546:0:15072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788612646.225559:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612646.225565:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612646.225568:0:15072:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788612646.225573:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788612646.225576:0:15072:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788612646.225578:0:15072:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788612646.225580:0:15072:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788612646.225582:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788612646.225584:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612646.225586:0:15072:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788612646.225588:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612646.225591:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612646.225593:0:15072:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788612646.225595:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788612646.225597:0:15072:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788612646.225599:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612646.225602:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612646.225603:0:15072:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788612646.225605:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612646.225608:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612646.225620:0:15072:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788612646.225634:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788612646.225694:0:15072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612646.225698:0:15072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612646.225699:0:15072:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788612646.225702:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788612646.226860:0:15058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788612646.226898:0:15058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788612646.226918:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af42872 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42879 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.226929:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b60000/0xfc956d548af42872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42879 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612646.226939:0:15058:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928ec00ff000 from 1 10000000:01000000:1.0:1788612646.226942:0:15058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788612646.226980:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.226989:0:15058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.227892:0:15058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612646.227922:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612646.227991:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612646.228158:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914398976 00000100:00100000:3.0:1788612646.228166:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914398976 00000100:00100000:1.0:1788612646.228243:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788612646.228352:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788612646.228362:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+14:15058:x1875495914398976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612646.228376:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612646.228388:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928d8789e800/0xfc956d548af42895 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af4288e expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.228412:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928d8789e800/0xfc956d548af42895 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af4288e expref: 15 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.228423:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928d8789e800/0xfc956d548af42895 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4288e expref: 15 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.228432:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928d8789e800, rc 0) 00000100:00100000:3.0:1788612646.228480:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+15:15058:x1875495914398976:12345-0@lo:101:mount.lustre.0 Request processed in 119us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612646.228487:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612646.228567:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914398976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612646.228580:0:15058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42895 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.228589:0:15058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af42895 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612646.229138:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788612646.229440:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612646.229676:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788612646.229721:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788612646.229777:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788612646.229783:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788612646.229832:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914399104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612646.229888:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.237436:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788612646.237537:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914399104 00000100:00100000:0.0:1788612646.237547:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914399104 00000100:00100000:0.0:1788612646.237594:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788612646.237602:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+15:15058:x1875495914399104:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612646.237947:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+15:15058:x1875495914399104:12345-0@lo:501:mount.lustre.0 Request processed in 345us (8057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612646.237956:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788612646.238775:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914399104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612646.238823:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914399232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612646.238906:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.238935:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788612646.239650:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914399232 00000100:00100000:0.0:1788612646.239658:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914399232 00000100:00100000:0.0:1788612646.239694:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788612646.239702:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+15:15058:x1875495914399232:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788612646.239927:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+15:15058:x1875495914399232:12345-0@lo:503:mount.lustre.0 Request processed in 225us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612646.239935:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788612646.240178:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914399232:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788612646.240682:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788612646.240766:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914399360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612646.240817:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.240885:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788612646.241788:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914399360 00000100:00100000:0.0:1788612646.241797:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914399360 00000100:00100000:0.0:1788612646.241834:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788612646.241855:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+15:15058:x1875495914399360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612646.242073:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+15:15058:x1875495914399360:12345-0@lo:502:mount.lustre.0 Request processed in 218us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612646.242082:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788612646.242288:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914399360:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612646.242560:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788612646.242622:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788612646.242679:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788612646.242719:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788612646.242758:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788612646.242797:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788612646.242825:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788612646.242883:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788612646.243139:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914399488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612646.243189:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.243223:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788612646.243363:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914399488 00000100:00100000:0.0:1788612646.243368:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914399488 00000100:00100000:0.0:1788612646.243402:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788612646.243409:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+15:15058:x1875495914399488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612646.243554:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+15:15058:x1875495914399488:12345-0@lo:502:mount.lustre.0 Request processed in 145us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612646.243561:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788612646.244255:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914399488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612646.244360:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788612646.244371:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788612646.245411:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612646.245421:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612646.245424:0:15076:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788612646.245430:0:15076:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff928ec00ff000 00000020:00000080:1.0:1788612646.245432:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788612646.245439:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612646.245441:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612646.245442:0:15076:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788612646.245454:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612646.245457:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612646.245459:0:15076:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788612646.245462:0:15076:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff928ec00ff000 00000020:00000080:1.0:1788612646.245464:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788612646.245525:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612646.245529:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612646.245530:0:15076:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788612646.245533:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612646.245535:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612646.245537:0:15076:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788612646.245540:0:15076:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff928ec00ff000 00000020:00000080:1.0:1788612646.245542:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788612646.245577:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612646.245580:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612646.245582:0:15076:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788612646.245584:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788612646.247895:0:15058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788612646.247946:0:15058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788612646.247963:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42895 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.247976:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42895 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612646.248036:0:15058:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788612646.248040:0:15058:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff928ec00ff000 10000000:01000000:1.0:1788612646.248043:0:15058:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff928ec00ff000 10000000:01000000:1.0:1788612646.248048:0:15058:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788612646.248053:0:15058:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff928ec00ff000 from 1 10000000:01000000:1.0:1788612646.248056:0:15058:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788612646.248089:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af4289c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.248103:0:15058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af4289c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.248113:0:15058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af4289c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612646.248137:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914399616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612646.248201:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.248246:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612646.251089:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914399616 00000100:00100000:1.0:1788612646.251102:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914399616 00000100:00100000:1.0:1788612646.251166:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788612646.251176:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+15:15058:x1875495914399616:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612646.251194:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612646.251213:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b60a00/0xfc956d548af428a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af4289c expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.251251:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b60a00/0xfc956d548af428a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af4289c expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.251263:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b60a00/0xfc956d548af428a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4289c expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.251271:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b60a00, rc 0) 00000100:00100000:1.0:1788612646.251340:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15058:x1875495914399616:12345-0@lo:101:mount.lustre.0 Request processed in 166us (3138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612646.251347:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788612646.251408:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914399616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612646.251426:0:15058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af4289c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af428a3 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612646.251435:0:15058:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af4289c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af428a3 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612646.252678:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788612646.254280:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612646.254555:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788612646.254593:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788612646.259404:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788612646.259540:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788612646.259581:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788612646.259629:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788612646.259664:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788612646.259739:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788612646.259804:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788612646.259862:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788612646.259898:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788612646.259959:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788612646.259995:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788612646.260040:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788612646.260088:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788612646.260124:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788612646.260159:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788612646.260207:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788612646.264082:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788612646.264169:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788612646.264254:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788612646.264292:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788612646.264321:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788612646.264387:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788612646.264425:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788612646.264457:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788612646.264503:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788612646.264538:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788612646.264638:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788612646.264646:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788612646.264973:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914399744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612646.265054:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.265100:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612646.265243:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914399744 00000100:00100000:0.0:1788612646.265251:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914399744 00000100:00100000:0.0:1788612646.265298:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788612646.265307:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15058:x1875495914399744:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612646.265523:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15058:x1875495914399744:12345-0@lo:501:mount.lustre.0 Request processed in 216us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612646.265531:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788612646.265790:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914399744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612646.265821:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914399872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612646.265878:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.265894:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612646.268032:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914399872 00000100:00100000:0.0:1788612646.268042:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914399872 00000100:00100000:0.0:1788612646.268083:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788612646.268091:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15058:x1875495914399872:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788612646.269052:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15058:x1875495914399872:12345-0@lo:503:mount.lustre.0 Request processed in 957us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612646.269062:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788612646.269785:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914399872:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788612646.273176:0:15058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788612646.273813:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914400000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612646.273904:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.274831:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612646.275117:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914400000 00000100:00100000:0.0:1788612646.275126:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914400000 00000100:00100000:0.0:1788612646.275176:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788612646.275184:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15058:x1875495914400000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612646.275416:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15058:x1875495914400000:12345-0@lo:502:mount.lustre.0 Request processed in 232us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612646.275424:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788612646.277532:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914400000:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612646.277885:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788612646.278166:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788612646.278202:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788612646.278321:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788612646.278361:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788612646.278410:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788612646.278443:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788612646.278489:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788612646.278540:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788612646.278576:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788612646.279318:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788612646.279388:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788612646.279417:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788612646.279443:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788612646.279478:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788612646.279505:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788612646.279529:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788612646.279577:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788612646.279608:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788612646.280415:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788612646.280461:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788612646.280488:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788612646.280513:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788612646.280565:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788612646.280593:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788612646.281715:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788612646.282348:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788612646.282393:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788612646.282428:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788612646.282474:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788612646.282508:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788612646.282542:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788612646.282578:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788612646.283346:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788612646.283396:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788612646.283446:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788612646.283480:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788612646.283529:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788612646.283577:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788612646.283640:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788612646.283694:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914400128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612646.283779:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612646.283829:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612646.284655:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914400128 00000100:00100000:0.0:1788612646.284663:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914400128 00000100:00100000:0.0:1788612646.284712:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788612646.285037:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15058:x1875495914400128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612646.285282:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15058:x1875495914400128:12345-0@lo:502:mount.lustre.0 Request processed in 561us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612646.285290:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788612646.286002:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914400128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612646.286126:0:15058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788612646.286140:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788612646.293496:0:15081:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788612646.293518:0:15081:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff928e90d4cd40) 00000020:00000080:3.0:1788612646.293535:0:15081:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788612646.293595:0:15081:0:(tgt_mount.c:153:server_get_mount()) get mount ffff928ec00ff000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788612646.293598:0:15081:0:(tgt_mount.c:187:server_put_mount()) put mount ffff928ec00ff000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788612646.293600:0:15081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff928ec00ff000 3 00010000:00080000:3.0:1788612646.293674:0:15081:0:(ldlm_lib.c:102:import_set_conn()) imp ffff928d849c1000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1788612646.297165:0:15081:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788612646.297431:0:15081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788612646.297468:0:15081:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788612646.297482:0:15081:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xfc956d548af428b1 00000100:00080000:1.0:1788612646.297493:0:15081:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788612646.297499:0:15081:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff928d849c1000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1788612646.297535:0:15081:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928eab92f480 x1875495914400256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788612646.297718:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875495914400256:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788612646.297891:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788612646.300308:0:15081:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788612646.300338:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612646.300342:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788612646.300345:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612646.300348:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788612646.300407:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914400384:0@lo:400:kworker.0 00000100:00100000:1.0:1788612646.300464:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612646.300638:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914400256 00000100:00100000:3.0:1788612646.300645:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914400256 00000100:00100000:3.0:1788612646.300677:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914400384 00000100:00100000:3.0:1788612646.300680:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914400384 00000100:00100000:3.0:1788612646.300704:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612646.300713:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914400384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612646.300773:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914400384:12345-0@lo:400:kworker.0 Request processed in 61us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612646.300781:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612646.300797:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612646.300802:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875495914400256:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788612646.300834:0:14377:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:3.0:1788612646.300886:0:14377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xfc956d548af428b8 00000004:00100000:3.0:1788612646.300901:0:14377:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788612646.300940:0:14377:0:(import.c:65:import_set_state_nolock()) ffff928d849c0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612646.300974:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875495914400256:12345-0@lo:38:llog_process_th.0 Request processed in 171us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612646.300980:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788612646.301022:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff928eab92f480 x1875495914400256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612646.301037:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788612646.301046:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788612646.301053:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788612646.301057:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788612646.301059:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928d849c1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788612646.301064:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875495914400256:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788612646.301094:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff928eab92c000 x1875495914400384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612646.301103:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914400384:0@lo:400:kworker.0 00000040:00080000:0.0:1788612646.304773:0:15081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788612646.304949:0:15058:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788612646.304976:0:15058:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788612646.305034:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af4289c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af428a3 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612646.305057:0:15058:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b61600/0xfc956d548af4289c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af428a3 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788612646.305101:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788612646.305103:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788612646.305105:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612646.305106:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612646.305107:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612646.305108:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612646.305110:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612646.305111:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612646.305112:0:15058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788612646.305116:0:15058:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788612646.305118:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788612646.305119:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788612646.305121:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612646.305122:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612646.305123:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612646.305124:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612646.305125:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612646.305126:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612646.305126:0:15058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788612646.305164:0:15058:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788612646.305183:0:15058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914400512:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788612646.305244:0:15058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612646.305280:0:15058:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e92428d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612646.306084:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914400512 00000100:00100000:3.0:1788612646.306094:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914400512 00000100:00100000:3.0:1788612646.306148:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788612646.306157:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15058:x1875495914400512:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788612646.306197:0:14372:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788612646.306212:0:14372:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1788612646.316980:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1788612646.329463:0:14372:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788612646.329484:0:14372:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788612646.329797:0:14393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788612646.329802:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788612646.329824:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612646.329870:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ea7bdec00/0xfc956d548af4282c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af42825 expref: 16 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612646.329879:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612646.330140:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ea7bdec00/0xfc956d548af4282c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af42825 expref: 16 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612646.330156:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928ea7bdec00/0xfc956d548af4282c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af42825 expref: 16 pid: 14372 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612646.330170:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd59880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1875495914400640:0@lo:104: 00000100:00100000:0.0:1788612646.330244:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612646.330295:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e855d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612646.330637:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914400640 00000100:00100000:2.0:1788612646.330647:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914400640 00000100:00100000:2.0:1788612646.330742:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612646.330756:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8d85c8a-0380-4a63-8187-d0137cefd572+3:14393:x1875495914400640:12345-0@lo:104: 00010000:00010000:2.0:1788612646.330771:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4282c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612646.331026:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612646.331034:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8d85c8a-0380-4a63-8187-d0137cefd572+3:14393:x1875495914400640:12345-0@lo:104: Request processed in 283us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612646.331041:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788612646.331091:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612646.331098:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af4282c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331106:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61e00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:3.0:1788612646.331110:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af4282c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331119:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af4282c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612646.331138:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af4282c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612646.331144:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612646.331176:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4282c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331182:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612646.331200:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4282c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331207:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e90b61e00/0xfc956d548af42825 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af4282c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331223:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612646.331225:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612646.331226:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612646.331245:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8d85c8a-0380-4a63-8187-d0137cefd572:3306:1875495914400768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612646.331276:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612646.331319:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914400768 00000100:00100000:3.0:1788612646.331323:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914400768 00010000:00010000:3.0:1788612646.331341:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ea7bdec00/0xfc956d548af4282c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af42825 expref: 17 pid: 14372 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612646.331363:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612646.331370:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8d85c8a-0380-4a63-8187-d0137cefd572+17:3306:x1875495914400768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612646.331379:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612646.331384:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ea7bdec00/0xfc956d548af4282c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af42825 expref: 17 pid: 14372 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331400:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ea7bdec00/0xfc956d548af4282c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af42825 expref: 17 pid: 14372 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331416:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331424:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788612646.331438:0:14364:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001636148s 00010000:00010000:3.0:1788612646.331442:0:14364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331448:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331455:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331461:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331466:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612646.331470:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331478:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331488:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612646.331504:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612646.331532:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8d85c8a-0380-4a63-8187-d0137cefd572+17:3306:x1875495914400768:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612646.331538:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612646.331572:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8d85c8a-0380-4a63-8187-d0137cefd572:3306:1875495914400768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612646.332460:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea7bdec00/0xfc956d548af4282c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af42825 expref: 16 pid: 14372 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612646.332480:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd59880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1875495914400640:0@lo:104: 00010000:00010000:0.0:1788612646.332498:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612646.332506:0:14393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612646.332511:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612646.332517:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea7bdf400/0xfc956d548af428bf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612646.355132:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+15:15058:x1875495914400512:12345-0@lo:253:mount.lustre.0 Request processed in 48965us (49877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612646.355147:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788612646.355263:0:15058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15058:1875495914400512:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788612646.355280:0:15058:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788612646.355284:0:15058:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788612646.355286:0:15058:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788612646.355287:0:15058:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612646.355289:0:15058:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612646.355290:0:15058:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612646.355291:0:15058:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612646.355293:0:15058:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612646.355294:0:15058:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612646.355296:0:15058:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788612646.355312:0:15058:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788612646.359257:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788612646.359785:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788612646.360087:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788612646.360225:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788612646.360354:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788612646.360743:0:15058:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788612646.361574:0:15058:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788612646.491213:0:15058:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788612646.491240:0:15058:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788612646.491278:0:15058:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788612646.491358:0:15058:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788612646.491372:0:15058:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788612646.491406:0:15058:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788612647.340165:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788612647.469388:0:14374:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788612647.469396:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff928e923eb800 from 7 10000000:01000000:1.0:1788612647.469400:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788612647.469440:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612647.469449:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612647.469457:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612647.469477:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914400896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788612647.469542:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612647.469580:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914400896 00000100:00100000:0.0:1788612647.469588:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914400896 00000100:00100000:1.0:1788612647.469596:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d87220a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612647.469639:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788612647.469647:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9a8c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+15:14374:x1875495914400896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612647.469660:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612647.469673:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea7bdf200/0xfc956d548af428cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af428c6 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612647.469695:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea7bdf200/0xfc956d548af428cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af428c6 expref: 16 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612647.469705:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea7bdf200/0xfc956d548af428cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af428c6 expref: 16 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612647.469713:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf200, rc 0) 00000100:00100000:0.0:1788612647.469823:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9a8c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+16:14374:x1875495914400896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612647.469830:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788612647.470270:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914400896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612647.470286:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af428cd expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612647.470296:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af428cd expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612647.470345:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914401024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788612647.470377:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612647.471208:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e86f726c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612647.471336:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914401024 00000100:00100000:2.0:1788612647.471407:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914401024 00000100:00100000:2.0:1788612647.471486:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788612647.471495:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9a8ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+16:14374:x1875495914401024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788612647.471526:0:14372:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788612647.471540:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788612647.471547:0:14372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788612647.471664:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9a8ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+16:14374:x1875495914401024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 170us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612647.471672:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788612647.471738:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914401024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788612647.471797:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788612647.471805:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af428cd expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612647.471814:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af428cd expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612648.364768:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612649.388807:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612650.416416:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612651.437250:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788612651.579441:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612651.579448:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612651.579451:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612651.579454:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788612651.579535:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914401280:0@lo:400:kworker.0 00000100:00100000:0.0:1788612651.579627:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612651.579997:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8d85c8a-0380-4a63-8187-d0137cefd572:3307:1875495914401152:0@lo:400:kworker.0 00000100:00100000:3.0:1788612651.580029:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612651.580064:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914401408:0@lo:400:kworker.0 00000100:00100000:3.0:1788612651.580085:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612651.580114:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914401280 00000100:00100000:3.0:1788612651.580122:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914401280 00000100:00100000:3.0:1788612651.580163:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914401408 00000100:00100000:3.0:1788612651.580166:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914401408 00000100:00100000:3.0:1788612651.580192:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612651.580200:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914401280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612651.580242:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914401280:12345-0@lo:400:kworker.0 Request processed in 42us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612651.580249:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612651.580277:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612651.580284:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914401408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612651.580313:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914401408:12345-0@lo:400:kworker.0 Request processed in 30us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612651.580326:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612651.580343:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914401152 00000100:00100000:3.0:1788612651.580347:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914401152 00000100:00100000:3.0:1788612651.580370:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788612651.580376:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+16:3307:x1875495914401152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612651.580408:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+16:3307:x1875495914401152:12345-0@lo:400:kworker.0 Request processed in 32us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612651.580414:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1788612651.580455:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788612651.580484:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928eacd5bb80 x1875495914401408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612651.580500:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914401408:0@lo:400:kworker.0 00000100:00100000:3.0:1788612651.580527:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8d85c8a-0380-4a63-8187-d0137cefd572:3307:1875495914401152:0@lo:400:kworker.0 00010000:00080000:0.0:1788612651.581081:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928eacd58700 x1875495914401280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612651.581092:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914401280:0@lo:400:kworker.0 00010000:00010000:3.0:1788612652.479159:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612653.484194:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612654.509761:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788612654.893372:0:15423:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788612655.538685:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788612655.980445:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788612656.556165:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788612656.687384:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612656.687391:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612656.687618:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612656.687622:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788612656.687684:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8d85c8a-0380-4a63-8187-d0137cefd572:3306:1875495914401536:0@lo:400:kworker.0 00000100:00100000:2.0:1788612656.687761:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612656.687826:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914401536 00000100:00100000:2.0:1788612656.687833:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914401536 00000100:00100000:2.0:1788612656.687895:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788612656.687906:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+16:3306:x1875495914401536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612656.687968:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+16:3306:x1875495914401536:12345-0@lo:400:kworker.0 Request processed in 64us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612656.687975:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788612656.688700:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914401664:0@lo:400:kworker.0 00000100:00100000:3.0:1788612656.688740:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612656.688768:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612656.688774:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914401792:0@lo:400:kworker.0 00000100:00100000:3.0:1788612656.688810:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612656.688857:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914401664 00000100:00100000:3.0:1788612656.688862:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914401664 00000100:00100000:3.0:1788612656.688887:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914401792 00000100:00100000:3.0:1788612656.688890:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914401792 00000100:00100000:3.0:1788612656.688915:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612656.688921:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914401664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612656.688971:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914401664:12345-0@lo:400:kworker.0 Request processed in 50us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612656.688977:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612656.688993:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612656.689000:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914401792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612656.690418:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8d85c8a-0380-4a63-8187-d0137cefd572:3306:1875495914401536:0@lo:400:kworker.0 00000100:00100000:3.0:1788612656.691089:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914401792:12345-0@lo:400:kworker.0 Request processed in 999us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612656.691104:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788612656.691147:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788612656.691183:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928eb7fcf800 x1875495914401792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612656.691197:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914401792:0@lo:400:kworker.0 00010000:00080000:3.0:1788612656.691210:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928eb7fcd180 x1875495914401664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612656.691230:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914401664:0@lo:400:kworker.0 00010000:00010000:1.0:1788612657.581008:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612658.604498:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612658.668931:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612643/real 1788612643] req@ffff928eb7fcc700 x1875495914397696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612658 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612658.668962:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff928eb7fcc700 x1875495914397696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612658 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612658.668972:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612643/real 1788612643] req@ffff928eb7fcea00 x1875495914397824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612658 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612658.668993:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff928eb7fcea00 x1875495914397824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612658 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788612658.669014:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928ebfb4c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612658.669042:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788612658.669046:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914397696:0@lo:8:kworker.0 00000100:00080000:1.0:1788612658.669051:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928eacf4b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612658.669057:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788612658.669060:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914397824:0@lo:8:kworker.0 00000100:00080000:0.0:1788612658.669281:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612658.669286:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788612658.669288:0:8:0:(import.c:65:import_set_state_nolock()) ffff928ebfb4c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612658.669294:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:0.0:1788612658.669299:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788612658.669306:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff928ebfb4c800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1788612658.669327:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928eacd59180 x1875495914402048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612658.669338:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612658.669341:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788612658.669343:0:8:0:(import.c:65:import_set_state_nolock()) ffff928eacf4b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612658.669346:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:0.0:1788612658.669348:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788612658.669352:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff928eacf4b800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1788612658.669362:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928eacd58e00 x1875495914402176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612658.669409:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914402304:0@lo:400:kworker.0 00000100:00100000:0.0:1788612658.669473:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612658.669519:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612658.669525:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8d85c8a-0380-4a63-8187-d0137cefd572:3306:1875495914401920:0@lo:400:kworker.0 00000100:00100000:0.0:1788612658.669560:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612658.669589:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914402432:0@lo:400:kworker.0 00000100:00100000:0.0:1788612658.669628:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612658.669662:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914402304 00000100:00100000:0.0:1788612658.669670:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914402304 00000100:00100000:0.0:1788612658.669709:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914402432 00000100:00100000:0.0:1788612658.669713:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914402432 00000100:00100000:0.0:1788612658.669739:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788612658.669747:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914402304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612658.669806:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914402304:12345-0@lo:400:kworker.0 Request processed in 59us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612658.669813:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788612658.669828:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788612658.669835:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914402432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612658.669888:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914402432:12345-0@lo:400:kworker.0 Request processed in 54us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612658.669894:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788612658.669915:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788612658.669948:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928eacd5a680 x1875495914402432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612658.669960:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914402432:0@lo:400:kworker.0 00010000:00080000:0.0:1788612658.669982:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928eacd5aa00 x1875495914402304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612658.669989:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914402304:0@lo:400:kworker.0 00000100:00100000:1.0:1788612658.670529:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914401920 00000100:00100000:1.0:1788612658.670535:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914401920 00000100:00100000:1.0:1788612658.670578:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788612658.670586:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+16:3306:x1875495914401920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612658.670632:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+16:3306:x1875495914401920:12345-0@lo:400:kworker.0 Request processed in 46us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612658.670638:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788612658.670668:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914402048:0@lo:8:kworker.0 00000100:00100000:1.0:1788612658.670698:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612658.670731:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914402176:0@lo:8:kworker.0 00000100:00100000:1.0:1788612658.670752:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612658.670808:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8d85c8a-0380-4a63-8187-d0137cefd572:3306:1875495914401920:0@lo:400:kworker.0 00000100:00100000:2.0:1788612658.670996:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914402048 00000100:00100000:2.0:1788612658.671002:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914402048 00000100:00100000:2.0:1788612658.671021:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914402176 00000100:00100000:2.0:1788612658.671024:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914402176 00000100:00100000:2.0:1788612658.671037:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612658.671043:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1875495914402048:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788612658.671065:0:15061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1788612658.671093:0:15061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfc956d548af428d4 00002000:00100000:2.0:1788612658.671106:0:15061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff928d86ab7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788612658.671110:0:15061:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788612658.671122:0:15061:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788612658.671767:0:15061:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788612658.671911:0:15061:0:(import.c:65:import_set_state_nolock()) ffff928d86ab3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788612658.671987:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875495914402048:12345-0@lo:8:kworker.0 Request processed in 942us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612658.671994:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612658.672014:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788612658.672020:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1875495914402176:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788612658.672032:0:15061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788612658.672058:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1875495914402176:12345-0@lo:8:kworker.0 Request processed in 38us (1305us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788612658.672064:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788612658.672434:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928eacd59180 x1875495914402048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612658.672452:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612658.672460:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788612658.672468:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788612658.672473:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788612658.672476:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928ebfb4c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788612658.672905:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788612658.672912:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914402048:0@lo:8:kworker.0 00000100:00080000:0.0:1788612658.672938:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928eacf4b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612658.672943:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788612658.672946:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914402176:0@lo:8:kworker.0 00000004:00080000:2.0:1788612658.673100:0:14399:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788612658.673442:0:14399:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 452516603014ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788612658.681426:0:14400:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1788612658.681457:0:14400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1875495914402688:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788612658.681523:0:14400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612658.681761:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914402560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612658.682308:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612658.688475:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914402560 00000100:00100000:3.0:1788612658.688495:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914402560 00000100:00100000:3.0:1788612658.688573:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612658.688599:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875495914402560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612658.688640:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612658.688736:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875495914402560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (6429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612658.688744:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788612658.688804:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928d8792d880 x1875495914402560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612658.688827:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914402560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612658.689727:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914402688 00000100:00100000:2.0:1788612658.689735:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914402688 00000100:00100000:2.0:1788612658.689772:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612658.689780:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14400:x1875495914402688:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788612658.692188:0:15061:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788612658.692199:0:15061:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788612658.692204:0:15061:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00080000:0.0:1788612658.693736:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612658.696008:0:14400:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e99337cc0 going to sleep for 11 seconds 00002000:00010000:2.0:1788612658.713609:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.713622:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af428db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.713647:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.713653:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.713659:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af428db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.713678:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af428db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.713690:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af428db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.713699:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af428db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.713729:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612658.713748:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612658.713754:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af428db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.713762:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12c00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612658.713767:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af428db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.713793:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af428db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.713821:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af428db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.713829:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af428db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.713888:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.713890:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.713891:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612658.714613:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.714620:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af428e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.714631:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.714634:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.714639:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af428e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.714648:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af428e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.714656:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af428e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.714664:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af428e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.714694:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612658.714704:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612658.714708:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af428e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.714716:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612658.714720:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af428e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.714729:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af428e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.714743:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af428e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.714750:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b9d2dc9/0xfc956d548af428e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.714768:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.714769:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.714771:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612658.715201:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.715208:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fdd5b0c/0xfc956d548af428e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715216:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.715225:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.715230:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fdd5b0c/0xfc956d548af428e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715240:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fdd5b0c/0xfc956d548af428e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715248:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fdd5b0c/0xfc956d548af428e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715255:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fdd5b0c/0xfc956d548af428e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715272:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612658.715282:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612658.715286:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fdd5b0c/0xfc956d548af428e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715293:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612658.715296:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fdd5b0c/0xfc956d548af428e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715304:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fdd5b0c/0xfc956d548af428e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715314:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fdd5b0c/0xfc956d548af428e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715333:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fdd5b0c/0xfc956d548af428e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715349:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.715351:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.715352:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612658.715770:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.715776:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af428f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715785:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.715788:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.715793:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af428f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715802:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af428f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715810:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af428f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715818:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af428f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715833:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612658.715869:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612658.715879:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af428f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715886:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612658.715889:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af428f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715896:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af428f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715906:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af428f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.715913:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af428f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.724301:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.724309:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.724312:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612658.725095:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.725105:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af428f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.725122:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.725127:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.725133:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af428f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.725159:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af428f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.725170:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af428f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.725179:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af428f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.725203:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612658.725216:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612658.725221:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af428f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.725229:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13a00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612658.725233:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af428f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.725242:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af428f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.725257:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af428f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.725266:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af428f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.725290:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.725292:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.725294:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612658.726683:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.726694:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af428fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.726708:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.726712:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.726718:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af428fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.727328:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af428fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.727342:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af428fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.727350:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af428fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.727366:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612658.727377:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612658.727383:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af428fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.727407:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612658.727411:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af428fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.727419:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af428fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.727435:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af428fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.727442:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af428fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.727465:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.727466:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.727468:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612658.729239:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.729250:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42905 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.729265:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.729270:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.729276:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.729288:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.729304:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.729313:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.729334:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612658.729345:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612658.729351:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.729359:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12a00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612658.729363:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.729372:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.729386:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42905 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.729393:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42905 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.729415:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.729422:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.729424:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612658.736073:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.736089:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af4290c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.736107:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.736111:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.736117:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af4290c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.736132:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af4290c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.736143:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af4290c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.736151:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af4290c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.736222:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612658.738324:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.738337:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af42913 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.738354:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.738358:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.738365:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af42913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.738385:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af42913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.738396:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af42913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.738404:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af42913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.750172:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612658.750187:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af4290c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.750202:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13e00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612658.750207:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af4290c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.750219:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af4290c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.750244:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af4290c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.750265:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000271063dd/0xfc956d548af4290c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.750294:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612658.750298:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af42913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.750305:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612658.750308:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af42913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.750316:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af42913 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.750325:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af42913 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.750332:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612658.750333:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612658.750335:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.750857:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612658.750866:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af42913 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.751067:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612658.751622:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.751631:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af4291a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.751645:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.751649:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.751656:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af4291a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.751668:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af4291a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.751687:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af4291a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.751693:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af4291a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.751717:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612658.752156:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.752163:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af42921 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.752172:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.752176:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.752180:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af42921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.752189:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af42921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.752196:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af42921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.752203:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af42921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.752239:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788612658.753276:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.753285:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42928 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.753297:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.753301:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.753306:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.753317:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.753326:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.753332:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.753340:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788612658.753734:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.753741:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af4292f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.753749:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.753759:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.753764:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af4292f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.753773:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af4292f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.753782:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af4292f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.753789:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af4292f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.753797:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788612658.754190:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788612658.754199:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af4291a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754207:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12c00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612658.754218:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af4291a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754228:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af4291a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754246:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af4291a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754254:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af4291a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754274:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788612658.754278:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af42921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754284:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612658.754287:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af42921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754294:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af42921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754303:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af42921 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754310:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af42921 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754331:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612658.754334:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754340:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0144200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612658.754342:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754349:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754359:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42928 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754366:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42928 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754378:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612658.754381:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af4292f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754387:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0145000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612658.754390:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af4292f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754408:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af4292f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754418:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af4292f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754425:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af4292f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.754440:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612658.754441:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612658.754443:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612658.754451:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612658.764400:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.764417:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066eabece/0xfc956d548af42936 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.764437:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.764442:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.764450:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066eabece/0xfc956d548af42936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.764466:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066eabece/0xfc956d548af42936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.764476:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066eabece/0xfc956d548af42936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.764494:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066eabece/0xfc956d548af42936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.764576:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612658.765067:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.765074:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d221e51/0xfc956d548af4293d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.765082:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.765086:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.765090:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d221e51/0xfc956d548af4293d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.765099:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d221e51/0xfc956d548af4293d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.765106:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d221e51/0xfc956d548af4293d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.765114:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d221e51/0xfc956d548af4293d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.768697:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612658.768714:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066eabece/0xfc956d548af42936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.768729:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0145200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612658.768734:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066eabece/0xfc956d548af42936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.768746:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066eabece/0xfc956d548af42936 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.768783:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066eabece/0xfc956d548af42936 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.768791:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066eabece/0xfc956d548af42936 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.768815:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612658.768819:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d221e51/0xfc956d548af4293d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.768825:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0145400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612658.768828:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d221e51/0xfc956d548af4293d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.768857:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d221e51/0xfc956d548af4293d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.768883:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d221e51/0xfc956d548af4293d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.768891:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.768893:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.768895:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.769271:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612658.769279:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d221e51/0xfc956d548af4293d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612658.770000:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.770007:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848e980c/0xfc956d548af42944 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.770020:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.770025:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.770031:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000848e980c/0xfc956d548af42944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.770043:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000848e980c/0xfc956d548af42944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.770053:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848e980c/0xfc956d548af42944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.770061:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000848e980c/0xfc956d548af42944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.770075:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612658.770467:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.770473:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b446886/0xfc956d548af4294b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.770481:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.770484:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.770494:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b446886/0xfc956d548af4294b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.770504:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b446886/0xfc956d548af4294b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.770512:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b446886/0xfc956d548af4294b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.770520:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b446886/0xfc956d548af4294b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.770528:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788612658.770977:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.770983:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d072c92e/0xfc956d548af42952 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.770993:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.770996:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.771000:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d072c92e/0xfc956d548af42952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.771009:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d072c92e/0xfc956d548af42952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.771016:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d072c92e/0xfc956d548af42952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.771034:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d072c92e/0xfc956d548af42952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.771042:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788612658.771412:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.771418:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc194ade/0xfc956d548af42959 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.771427:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.771431:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.771435:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc194ade/0xfc956d548af42959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.771444:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc194ade/0xfc956d548af42959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.771451:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc194ade/0xfc956d548af42959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.771458:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc194ade/0xfc956d548af42959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.771466:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788612658.772833:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788612658.772860:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000848e980c/0xfc956d548af42944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.772871:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0144800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612658.772876:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000848e980c/0xfc956d548af42944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.772885:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000848e980c/0xfc956d548af42944 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.772905:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000848e980c/0xfc956d548af42944 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.772913:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000848e980c/0xfc956d548af42944 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.772949:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788612658.772953:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b446886/0xfc956d548af4294b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.772978:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0144a00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612658.772981:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b446886/0xfc956d548af4294b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.772989:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b446886/0xfc956d548af4294b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.772999:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b446886/0xfc956d548af4294b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.773006:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b446886/0xfc956d548af4294b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.773019:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612658.773023:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d072c92e/0xfc956d548af42952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.773029:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0145a00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612658.773031:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d072c92e/0xfc956d548af42952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.773038:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d072c92e/0xfc956d548af42952 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.773047:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d072c92e/0xfc956d548af42952 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.773060:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d072c92e/0xfc956d548af42952 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.773074:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612658.773077:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc194ade/0xfc956d548af42959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.773083:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0145c00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612658.773086:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc194ade/0xfc956d548af42959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.773093:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc194ade/0xfc956d548af42959 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.773103:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc194ade/0xfc956d548af42959 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.773110:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc194ade/0xfc956d548af42959 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.773122:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.773124:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.773125:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.773133:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612658.782472:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.782487:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af42960 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.782523:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.782539:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.782546:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af42960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.782560:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af42960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.782570:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af42960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.782578:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af42960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.782604:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612658.782879:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612658.782886:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af42960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.782901:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0145000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612658.782905:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af42960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.782914:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af42960 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.782940:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af42960 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.782949:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bd70203/0xfc956d548af42960 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.782970:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.782972:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.782974:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612658.783463:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.783470:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42967 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.783479:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.783483:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.783487:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.783497:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.783516:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.783523:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42967 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.783583:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612658.784136:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.784142:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af4296e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.784152:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.784155:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.784160:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af4296e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.784171:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af4296e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.784178:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af4296e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.784186:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af4296e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.792941:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612658.792959:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42967 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.792974:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0144200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612658.792980:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42967 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.792993:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42967 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.793029:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42967 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.793037:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681b4879/0xfc956d548af42967 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.793314:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612658.794195:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.794201:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af42975 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.794213:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.794217:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.794221:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af42975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.794231:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af42975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.794237:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af42975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.794242:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af42975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.794248:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788612658.794683:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.794688:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4297c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.794694:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.794701:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.794704:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4297c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.794710:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4297c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.794715:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4297c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.794719:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4297c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.794724:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788612658.795191:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788612658.795197:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af4296e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795203:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612658.795207:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af4296e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795213:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af4296e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795226:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af4296e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795231:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095c31a92/0xfc956d548af4296e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795243:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612658.795245:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af42975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795254:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12c00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612658.795256:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af42975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795271:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af42975 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795277:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af42975 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795281:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff219400/0xfc956d548af42975 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795290:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612658.795292:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4297c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795296:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612658.795298:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4297c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795302:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4297c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795306:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4297c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795314:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008df3e710/0xfc956d548af4297c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.795321:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.795322:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.795323:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612658.795482:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.795486:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42983 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.795493:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.795495:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.795498:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.795504:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.795509:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.795517:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.796074:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.796076:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.796078:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.796641:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612658.797126:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.797132:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af4298a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.797142:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.797144:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.797148:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af4298a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.797156:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af4298a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.797161:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af4298a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.797166:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af4298a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.801657:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612658.801669:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.801682:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12a00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612658.801687:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.801700:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42983 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.801723:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42983 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.801730:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a40b4225/0xfc956d548af42983 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.801765:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612658.801769:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af4298a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.801776:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612658.801780:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af4298a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.801787:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af4298a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.801798:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af4298a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.801805:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.801807:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.801809:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612658.804365:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612658.804380:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056f4bb33/0xfc956d548af4298a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.804438:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612658.805382:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.805391:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af42991 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.805405:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.805409:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.805415:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af42991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.805428:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af42991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.805437:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af42991 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.805444:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af42991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.805458:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612658.805934:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612658.805942:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af42991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.805951:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13a00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612658.805955:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af42991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.805975:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af42991 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.805990:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af42991 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.805997:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042c7ad7c/0xfc956d548af42991 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612658.806012:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.806013:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612658.806015:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612658.808631:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612658.808646:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af42998 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.808663:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788612658.808668:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612658.808684:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af42998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.808698:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af42998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.808708:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af42998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.808715:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af42998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612658.808748:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612658.809126:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612658.809135:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af42998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.809144:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612658.809149:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af42998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.809158:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af42998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.809178:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af42998 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.809196:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000756d0c82/0xfc956d548af42998 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612658.809220:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612658.809222:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612658.809225:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788612658.809365:0:15061:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1788612658.810384:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14400:x1875495914402688:12345-0@lo:5:osp-pre-0-0.0 Request processed in 120597us (128854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612658.810396:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:3.0:1788612658.811291:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788612658.814212:0:14400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1875495914402688:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788612658.814234:0:14400:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788612658.814296:0:14400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1875495914402816:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788612658.814357:0:14400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612658.814410:0:14400:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8320a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788612658.814547:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914402816 00000100:00100000:3.0:1788612658.814554:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914402816 00000100:00100000:3.0:1788612658.814611:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612658.814621:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14400:x1875495914402816:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788612658.814667:0:15059:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788612658.824655:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14400:x1875495914402816:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10029us (10290us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788612658.824668:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612658.824819:0:14400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1875495914402816:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788612658.824863:0:14400:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788612659.636045:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612660.653044:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612661.676818:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788612661.961750:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788612661.961773:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1788612662.701604:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788612663.670496:0:15776:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788612663.670502:0:15776:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788612663.670673:0:15776:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff928d86ab4800 00000020:01000004:2.0:1788612663.670706:0:15776:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788612663.670721:0:15776:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788612663.671465:0:15776:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff928e86f00000) 00000020:00000080:3.0:1788612663.671495:0:15776:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788612663.691801:0:15776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788612663.692251:0:15776:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788612663.693035:0:15776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788612663.693259:0:15776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788612663.693968:0:15776:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788612663.694330:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:3.0:1788612663.694420:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:3.0:1788612663.694575:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:3.0:1788612663.695247:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:3.0:1788612663.695595:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1788612663.696299:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:2.0:1788612663.696675:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:2.0:1788612663.697080:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:2.0:1788612663.697370:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00000020:00000080:2.0:1788612663.698702:0:15776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788612663.698720:0:15776:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788612663.698818:0:15776:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfc956d548af429a6 00000020:01000004:2.0:1788612663.698831:0:15776:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788612663.698897:0:15776:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788612663.698903:0:15776:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788612663.698911:0:15776:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788612663.698941:0:15776:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788612663.698946:0:15776:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788612663.708964:0:15776:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788612663.709018:0:15776:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.106@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788612663.709023:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788612663.709026:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788612663.709027:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612663.709028:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612663.709030:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612663.709032:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612663.709034:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612663.709036:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612663.709037:0:15776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788612663.709043:0:15776:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788612663.709045:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788612663.709047:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788612663.709048:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612663.709049:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612663.709051:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612663.709052:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612663.709053:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612663.709054:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612663.709056:0:15776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788612663.709104:0:15776:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788612663.709134:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914402944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788612663.709229:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.709379:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612663.709439:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914402944 00000100:00100000:3.0:1788612663.709521:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914402944 00000100:00100000:3.0:1788612663.709637:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788612663.709649:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15776:x1875495914402944:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788612663.709687:0:14370:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788612663.709690:0:14370:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788612663.709695:0:14370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788612663.722438:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15776:x1875495914402944:12345-0@lo:253:mount.lustre.0 Request processed in 12776us (13194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612663.722472:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788612663.722672:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914402944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788612663.722693:0:15776:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788612663.722697:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788612663.722698:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788612663.722700:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612663.722701:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612663.722702:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612663.722704:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612663.722705:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612663.722707:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612663.722709:0:15776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788612663.722797:0:15776:0:(tgt_mount.c:101:server_register_mount()) register mount ffff928d86ab4800 from lustre-OST0001 10000000:01000000:2.0:1788612663.722833:0:15776:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788612663.722857:0:15776:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788612663.722876:0:15776:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff928e90d48000 local copy 00010000:00010000:2.0:1788612663.722891:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea7bdfe00/0xfc956d548af4274c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42753 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612663.723174:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612663.723216:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.723298:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8320a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612663.723341:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914403072 00000100:00100000:0.0:1788612663.723348:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914403072 00000100:00100000:0.0:1788612663.723454:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788612663.723471:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15776:x1875495914403072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612663.723656:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15776:x1875495914403072:12345-0@lo:501:mount.lustre.0 Request processed in 187us (438us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788612663.723673:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788612663.723752:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403072:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788612663.723767:0:15776:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788612663.723981:0:15776:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788612663.723989:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea7bdfe00/0xfc956d548af4274c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42753 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612663.724000:0:15776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ea7bdfe00/0xfc956d548af4274c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42753 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612663.724024:0:15776:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff928d86ab4800 10000000:01000000:2.0:1788612663.724034:0:15776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788612663.724039:0:15776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788612663.724041:0:15776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788612663.724047:0:15776:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788612663.724050:0:15776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788612663.724078:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928eacd13e00/0xfc956d548af429ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612663.724087:0:15776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928eacd13e00/0xfc956d548af429ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612663.724097:0:15776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928eacd13e00/0xfc956d548af429ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612663.724111:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788612663.724138:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612663.724305:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612663.725055:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8320a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612663.725157:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914403200 00000100:00100000:1.0:1788612663.725167:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914403200 00000100:00100000:1.0:1788612663.725212:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788612663.725221:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+16:15776:x1875495914403200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612663.725235:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612663.725251:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b61400/0xfc956d548af429b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af429ad expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.725281:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b61400/0xfc956d548af429b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af429ad expref: 17 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.725293:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b61400/0xfc956d548af429b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af429ad expref: 17 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.725304:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61400, rc 0) 00000100:00100000:1.0:1788612663.725383:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+17:15776:x1875495914403200:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612663.725390:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788612663.725642:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612663.725661:0:15776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928eacd13e00/0xfc956d548af429ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af429b4 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612663.725672:0:15776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928eacd13e00/0xfc956d548af429ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af429b4 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612663.726732:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788612663.728178:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612663.728750:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788612663.728804:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788612663.728896:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788612663.728952:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788612663.729007:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788612663.729043:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788612663.729119:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788612663.729129:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788612663.729245:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612663.729334:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.729384:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8320a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612663.729690:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914403328 00000100:00100000:1.0:1788612663.729701:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914403328 00000100:00100000:1.0:1788612663.729764:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788612663.729774:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+17:15776:x1875495914403328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612663.730236:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+17:15776:x1875495914403328:12345-0@lo:501:mount.lustre.0 Request processed in 461us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612663.730245:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788612663.731771:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612663.731878:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612663.731977:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.732029:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8320a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612663.732163:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914403456 00000100:00100000:1.0:1788612663.732173:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914403456 00000100:00100000:1.0:1788612663.732236:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788612663.732248:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+17:15776:x1875495914403456:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612663.732879:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+17:15776:x1875495914403456:12345-0@lo:503:mount.lustre.0 Request processed in 591us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612663.732889:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788612663.733176:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403456:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788612663.734404:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788612663.734684:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612663.735120:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.735173:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ea340e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612663.735215:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914403584 00000100:00100000:3.0:1788612663.735224:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914403584 00000100:00100000:3.0:1788612663.735365:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788612663.735377:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+17:15776:x1875495914403584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612663.735686:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+17:15776:x1875495914403584:12345-0@lo:502:mount.lustre.0 Request processed in 311us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612663.735694:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788612663.735802:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612663.736127:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788612663.736192:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788612663.736228:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788612663.736280:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788612663.736319:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788612663.736355:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788612663.736403:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788612663.736442:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788612663.736495:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788612663.736538:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612663.736599:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.737178:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e8320a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612663.737233:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914403712 00000100:00100000:0.0:1788612663.737241:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914403712 00000100:00100000:0.0:1788612663.737290:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788612663.737300:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+17:15776:x1875495914403712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612663.737736:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+17:15776:x1875495914403712:12345-0@lo:502:mount.lustre.0 Request processed in 426us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612663.737744:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788612663.738034:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612663.738154:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788612663.738173:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788612663.742607:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788612663.742624:0:15777:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788612663.742634:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612663.742637:0:15777:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788612663.742649:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788612663.742669:0:15777:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff928e985499c0) 00000020:00000080:2.0:1788612663.742700:0:15777:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788612663.742706:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788612663.743005:0:15777:0:(tgt_mount.c:153:server_get_mount()) get mount ffff928d86ab4800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788612663.743016:0:15777:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788612663.743025:0:15777:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfc956d548af429c2 00010000:00010000:2.0:1788612663.748119:0:15777:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788612663.749202:0:15777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788612663.753063:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788612663.754874:0:15777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788612663.754894:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612663.754902:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612663.754904:0:15777:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788612663.754908:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612663.754913:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612663.754915:0:15777:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788612663.754918:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788612663.754920:0:15777:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788612663.754922:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612663.754925:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612663.754926:0:15777:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788612663.754936:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612663.754940:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612663.754941:0:15777:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788612663.754945:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788612663.755022:0:15777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612663.755024:0:15777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612663.755026:0:15777:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788612663.755029:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788612663.755297:0:15776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788612663.755333:0:15776:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788612663.755366:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928eacd13e00/0xfc956d548af429ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af429b4 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612663.755382:0:15776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928eacd13e00/0xfc956d548af429ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af429b4 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612663.755393:0:15776:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928d86ab4800 from 1 10000000:01000000:0.0:1788612663.755396:0:15776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612663.755458:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612663.755476:0:15776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612663.755491:0:15776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612663.755525:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403840:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788612663.755624:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612663.755689:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d87220240 going to sleep for 11 seconds 00000100:00100000:2.0:1788612663.755958:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914403840 00000100:00100000:2.0:1788612663.755968:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914403840 00000100:00100000:2.0:1788612663.756016:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788612663.756026:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+17:15776:x1875495914403840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612663.756042:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612663.756058:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928eacd13000/0xfc956d548af429d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af429c9 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612663.756086:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928eacd13000/0xfc956d548af429d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af429c9 expref: 18 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612663.756099:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928eacd13000/0xfc956d548af429d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af429c9 expref: 18 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612663.756109:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd13000, rc 0) 00000100:00100000:2.0:1788612663.756151:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+18:15776:x1875495914403840:12345-0@lo:101:mount.lustre.0 Request processed in 126us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612663.756158:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788612663.756362:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612663.756380:0:15776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af429d0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612663.756392:0:15776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af429d0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788612663.757228:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788612663.761431:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612663.764898:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788612663.765006:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788612663.765089:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788612663.765099:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788612663.765257:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403968:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612663.765347:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612663.765398:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d87f5ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612663.767252:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914403968 00000100:00100000:3.0:1788612663.767270:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914403968 00000100:00100000:3.0:1788612663.767347:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788612663.767360:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+18:15776:x1875495914403968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612663.767870:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+18:15776:x1875495914403968:12345-0@lo:501:mount.lustre.0 Request processed in 502us (2512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612663.767881:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788612663.767963:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914403968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612663.768037:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612663.768091:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612663.768133:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec065b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612663.768569:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914404096 00000100:00100000:1.0:1788612663.768576:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914404096 00000100:00100000:1.0:1788612663.768618:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788612663.768634:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+18:15776:x1875495914404096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612663.768809:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+18:15776:x1875495914404096:12345-0@lo:503:mount.lustre.0 Request processed in 177us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612663.768817:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788612663.768961:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404096:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788612663.770829:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788612663.771436:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612663.775533:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612663.775606:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec065b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612663.775746:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914404224 00000100:00100000:2.0:1788612663.775758:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914404224 00000100:00100000:2.0:1788612663.775828:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788612663.775884:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+18:15776:x1875495914404224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612663.776197:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+18:15776:x1875495914404224:12345-0@lo:502:mount.lustre.0 Request processed in 358us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612663.776206:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788612663.776311:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612663.776746:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788612663.776806:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788612663.776911:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788612663.776952:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788612663.776985:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788612663.777031:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788612663.777067:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788612663.777097:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788612663.777147:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612663.777206:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.777250:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612663.777532:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914404352 00000100:00100000:0.0:1788612663.777540:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914404352 00000100:00100000:0.0:1788612663.777595:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788612663.777605:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+18:15776:x1875495914404352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612663.777825:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+18:15776:x1875495914404352:12345-0@lo:502:mount.lustre.0 Request processed in 221us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612663.777833:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788612663.778141:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612663.778272:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788612663.778288:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788612663.781071:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612663.781088:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612663.781091:0:15781:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788612663.781097:0:15781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff928d86ab4800 00000020:00000080:1.0:1788612663.781100:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788612663.781109:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612663.781112:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612663.781113:0:15781:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788612663.781115:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612663.781117:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612663.781118:0:15781:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788612663.781121:0:15781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff928d86ab4800 00000020:00000080:1.0:1788612663.781123:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788612663.781571:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612663.781577:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612663.781579:0:15781:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788612663.781582:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612663.781585:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612663.781587:0:15781:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788612663.781590:0:15781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff928d86ab4800 00000020:00000080:1.0:1788612663.781592:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788612663.783952:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612663.783969:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612663.783971:0:15781:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788612663.783976:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788612663.784213:0:15776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788612663.784251:0:15776:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612663.784280:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af429d0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612663.784294:0:15776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af429d0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612663.784353:0:15776:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788612663.784363:0:15776:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff928d86ab4800 10000000:01000000:2.0:1788612663.784367:0:15776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff928d86ab4800 10000000:01000000:2.0:1788612663.784372:0:15776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788612663.784380:0:15776:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff928d86ab4800 from 1 10000000:01000000:2.0:1788612663.784383:0:15776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788612663.784439:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928eacd12000/0xfc956d548af429d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612663.784448:0:15776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928eacd12000/0xfc956d548af429d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612663.784529:0:15776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928eacd12000/0xfc956d548af429d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612663.784563:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788612663.784653:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.784712:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612663.785918:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914404480 00000100:00100000:1.0:1788612663.785931:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914404480 00000100:00100000:1.0:1788612663.785992:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788612663.786012:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+18:15776:x1875495914404480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612663.786032:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612663.786050:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b61a00/0xfc956d548af429de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af429d7 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.786082:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b61a00/0xfc956d548af429de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af429d7 expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.786095:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b61a00/0xfc956d548af429de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af429d7 expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.786106:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61a00, rc 0) 00000100:00100000:1.0:1788612663.786194:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+19:15776:x1875495914404480:12345-0@lo:101:mount.lustre.0 Request processed in 186us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612663.786203:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788612663.786324:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612663.786348:0:15776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928eacd12000/0xfc956d548af429d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af429de expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612663.786359:0:15776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928eacd12000/0xfc956d548af429d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af429de expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612663.787381:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788612663.788288:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612663.788957:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788612663.789028:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788612663.789066:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788612663.789114:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788612663.789166:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788612663.789220:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788612663.789257:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788612663.789291:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788612663.789338:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788612663.789375:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788612663.789409:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788612663.789457:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788612663.789573:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788612663.789607:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788612663.789654:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788612663.789687:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788612663.789720:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788612663.789941:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788612663.789980:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788612663.790013:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788612663.790061:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788612663.790096:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788612663.790126:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788612663.790172:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788612663.790205:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788612663.790238:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788612663.790289:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788612663.790325:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788612663.790361:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788612663.790412:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788612663.790449:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788612663.790623:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788612663.790658:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788612663.790813:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788612663.790944:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788612663.791000:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788612663.791037:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788612663.791161:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788612663.791170:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788612663.791338:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612663.791442:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.791606:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612663.791704:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914404608 00000100:00100000:1.0:1788612663.791717:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914404608 00000100:00100000:1.0:1788612663.791792:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788612663.791803:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+19:15776:x1875495914404608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612663.792126:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+19:15776:x1875495914404608:12345-0@lo:501:mount.lustre.0 Request processed in 324us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612663.792134:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788612663.792376:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612663.792421:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612663.792592:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.792658:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612663.792698:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914404736 00000100:00100000:1.0:1788612663.792704:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914404736 00000100:00100000:1.0:1788612663.792828:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788612663.792870:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+19:15776:x1875495914404736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612663.793066:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+19:15776:x1875495914404736:12345-0@lo:503:mount.lustre.0 Request processed in 229us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612663.793081:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788612663.793172:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788612663.794111:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788612663.794210:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612663.794277:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.794370:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788612663.794413:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914404864 00000100:00100000:1.0:1788612663.794421:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914404864 00000100:00100000:1.0:1788612663.794550:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788612663.794562:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+19:15776:x1875495914404864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612663.794931:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+19:15776:x1875495914404864:12345-0@lo:502:mount.lustre.0 Request processed in 370us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612663.794940:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788612663.795044:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612663.795308:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788612663.795368:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788612663.795404:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788612663.795457:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788612663.795604:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788612663.795654:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788612663.795693:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788612663.795816:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788612663.795985:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788612663.796025:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788612663.796063:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788612663.796111:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788612663.796160:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788612663.796189:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788612663.796237:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788612663.796271:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788612663.796302:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788612663.796357:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788612663.796394:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788612663.797589:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788612663.797716:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788612663.797828:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788612663.797893:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788612663.797990:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788612663.798040:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788612663.798069:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788612663.798111:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788612663.798142:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788612663.798171:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788612663.798211:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788612663.798242:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788612663.798270:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788612663.798299:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788612663.798359:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788612663.798418:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788612663.799634:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788612663.799721:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788612663.799870:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788612663.799939:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788612663.799979:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788612663.800568:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612663.800676:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.801585:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc840 going to sleep for 11 seconds 00000100:00100000:0.0:1788612663.801687:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914404992 00000100:00100000:0.0:1788612663.801699:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914404992 00000100:00100000:0.0:1788612663.801778:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788612663.801789:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+19:15776:x1875495914404992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612663.802179:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+19:15776:x1875495914404992:12345-0@lo:502:mount.lustre.0 Request processed in 390us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612663.802189:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788612663.802420:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914404992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612663.802647:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788612663.802666:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788612663.805177:0:15786:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788612663.805207:0:15786:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff928d85838000) 00000020:00000080:0.0:1788612663.805234:0:15786:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788612663.805327:0:15786:0:(tgt_mount.c:153:server_get_mount()) get mount ffff928d86ab4800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788612663.805332:0:15786:0:(tgt_mount.c:187:server_put_mount()) put mount ffff928d86ab4800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788612663.805336:0:15786:0:(obd_mount.c:710:lustre_put_lsi()) put ffff928d86ab4800 3 00010000:00080000:0.0:1788612663.805374:0:15786:0:(ldlm_lib.c:102:import_set_conn()) imp ffff928ebf87c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1788612663.814149:0:15786:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788612663.815047:0:15786:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788612663.815105:0:15786:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788612663.815123:0:15786:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xfc956d548af429ec 00000100:00080000:2.0:1788612663.815137:0:15786:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612663.815145:0:15786:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff928ebf87c000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1788612663.815204:0:15786:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928d8792c700 x1875495914405120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788612663.815237:0:15786:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788612663.815305:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612663.815310:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788612663.815312:0:8:0:(import.c:65:import_set_state_nolock()) ffff928eacf4b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788612663.815317:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 452 00000100:00100000:0.0:1788612663.815560:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875495914405120:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788612663.815658:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612663.815753:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914405120 00000100:00100000:0.0:1788612663.815763:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914405120 00000100:00100000:0.0:1788612663.815800:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612663.815811:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875495914405120:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788612663.815868:0:14377:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:0.0:1788612663.815907:0:14377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xfc956d548af429f3 00000004:00100000:0.0:1788612663.815925:0:14377:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788612663.815964:0:14377:0:(import.c:65:import_set_state_nolock()) ffff928ebf87d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612663.816017:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875495914405120:12345-0@lo:38:llog_process_th.0 Request processed in 206us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612663.816024:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788612663.816070:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928d8792c700 x1875495914405120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612663.816083:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612663.816092:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788612663.816100:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788612663.816105:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788612663.816107:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928ebf87c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788612663.816114:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:0.0:1788612663.816114:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875495914405120:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788612663.816120:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff928eacf4b800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1788612663.816140:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928d8792e300 x1875495914405376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788612663.816220:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914405248:0@lo:400:kworker.0 00000100:00100000:2.0:1788612663.816258:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.816284:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612663.816290:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914405504:0@lo:400:kworker.0 00000100:00100000:2.0:1788612663.816311:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.816575:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914405632:0@lo:400:kworker.0 00000100:00100000:2.0:1788612663.816618:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.816650:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914405248 00000100:00100000:2.0:1788612663.816656:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914405248 00000100:00100000:2.0:1788612663.816703:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612663.816712:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914405248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612663.816753:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914405248:12345-0@lo:400:kworker.0 Request processed in 43us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612663.816761:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788612663.816790:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914405504 00000100:00100000:2.0:1788612663.816793:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914405504 00000100:00100000:2.0:1788612663.816816:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914405632 00000100:00100000:2.0:1788612663.816819:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914405632 00000100:00100000:2.0:1788612663.816855:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612663.816873:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914405504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612663.817432:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875495914405504:12345-0@lo:400:kworker.0 Request processed in 560us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612663.817440:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612663.817468:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788612663.817549:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914405376:0@lo:8:kworker.0 00000100:00100000:0.0:1788612663.817587:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.817598:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914405632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612663.817635:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875495914405632:12345-0@lo:400:kworker.0 Request processed in 161us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612663.817642:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788612663.817661:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612663.817666:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612663.817679:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914405376 00000100:00100000:2.0:1788612663.817684:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914405376 00000100:00100000:2.0:1788612663.817701:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788612663.817706:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1875495914405376:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788612663.817767:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1875495914405376:12345-0@lo:8:kworker.0 Request processed in 60us (179us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788612663.817774:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788612663.817829:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928d8792e680 x1875495914405632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788612663.817930:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff928d8792f480 x1875495914405504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612663.817943:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875495914405504:0@lo:400:kworker.0 00000100:00100000:0.0:1788612663.817957:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788612663.817974:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914405248:0@lo:400:kworker.0 00000100:00100000:2.0:1788612663.818395:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875495914405632:0@lo:400:kworker.0 00000100:00100000:1.0:1788612663.818450:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788612663.818572:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928eacf4b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612663.818579:0:3304:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788612663.818583:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914405376:0@lo:8:kworker.0 00000040:00080000:0.0:1788612663.818986:0:15786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788612663.822082:0:15776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788612663.822143:0:15776:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788612663.822175:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928eacd12000/0xfc956d548af429d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af429de expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612663.822189:0:15776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928eacd12000/0xfc956d548af429d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af429de expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788612663.822247:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788612663.822250:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788612663.822251:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612663.822253:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612663.822255:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612663.822256:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612663.822258:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612663.822260:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612663.822262:0:15776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788612663.822267:0:15776:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788612663.822271:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788612663.822273:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788612663.822274:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612663.822275:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612663.822276:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612663.822277:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612663.822278:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612663.822279:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612663.822280:0:15776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788612663.822325:0:15776:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788612663.822351:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914405760:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788612663.822461:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612663.822508:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec00dc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612663.822600:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914405760 00000100:00100000:3.0:1788612663.822610:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914405760 00000100:00100000:3.0:1788612663.822668:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788612663.822677:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+19:15776:x1875495914405760:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788612663.822712:0:14370:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788612663.822729:0:14370:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788612663.852746:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914405888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612663.852873:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612663.853003:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914405888 00000100:00100000:0.0:1788612663.853014:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914405888 00000100:00100000:0.0:1788612663.853067:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612663.853076:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914405888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788612663.853122:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612663.853184:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914405888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612663.853192:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612663.853818:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914405888:0@lo:13:osp-pre-0-0.0 20000000:01000000:2.0:1788612663.868095:0:14370:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788612663.868150:0:14370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788612663.869897:0:14393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788612663.869911:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788612663.869943:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612663.869968:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ea7bdf200/0xfc956d548af428cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af428c6 expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612663.869977:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612663.870052:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ea7bdf200/0xfc956d548af428cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af428c6 expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612663.870069:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928ea7bdf200/0xfc956d548af428cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af428c6 expref: 19 pid: 14370 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612663.870087:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1875495914406016:0@lo:104: 00000100:00100000:0.0:1788612663.870170:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612663.870240:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e993379c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612663.870311:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914406016 00000100:00100000:2.0:1788612663.870321:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914406016 00000100:00100000:2.0:1788612663.870396:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612663.870408:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8d85c8a-0380-4a63-8187-d0137cefd572+3:14393:x1875495914406016:12345-0@lo:104: 00010000:00010000:2.0:1788612663.870425:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af428cd expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612663.870661:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612663.870669:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8d85c8a-0380-4a63-8187-d0137cefd572+3:14393:x1875495914406016:12345-0@lo:104: Request processed in 264us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612663.870677:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788612663.870752:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612663.870760:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af428cd expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.870769:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61c00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:1.0:1788612663.870773:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af428cd expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.870783:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af428cd expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612663.870790:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af428cd expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612663.870796:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788612663.870888:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af428cd expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.870895:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612663.870922:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af428cd expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.870930:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e90b61c00/0xfc956d548af428c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af428cd expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.870950:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612663.870952:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612663.870954:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612663.870969:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8d85c8a-0380-4a63-8187-d0137cefd572:3305:1875495914406144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612663.871005:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612663.871297:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914406144 00000100:00100000:1.0:1788612663.871303:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914406144 00010000:00010000:1.0:1788612663.871329:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ea7bdf200/0xfc956d548af428cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af428c6 expref: 20 pid: 14370 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612663.871355:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612663.871363:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8d85c8a-0380-4a63-8187-d0137cefd572+20:3305:x1875495914406144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612663.871376:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612663.871381:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ea7bdf200/0xfc956d548af428cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af428c6 expref: 20 pid: 14370 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.871393:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ea7bdf200/0xfc956d548af428cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af428c6 expref: 20 pid: 14370 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.871413:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.871431:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788612663.871449:0:14364:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001636148s 00010000:00010000:1.0:1788612663.871613:0:14364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.871624:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.871630:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.871637:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.871642:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612663.871646:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.871654:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.871664:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612663.871676:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612663.871716:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8d85c8a-0380-4a63-8187-d0137cefd572+20:3305:x1875495914406144:12345-0@lo:103:ldlm_bl.0 Request processed in 353us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612663.871789:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612663.871891:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8d85c8a-0380-4a63-8187-d0137cefd572:3305:1875495914406144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612663.872096:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea7bdf200/0xfc956d548af428cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af428c6 expref: 19 pid: 14370 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612663.872112:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1875495914406016:0@lo:104: 00010000:00010000:0.0:1788612663.872130:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612663.872139:0:14393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612663.872145:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612663.872150:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea7bdf400/0xfc956d548af429fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612663.882938:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+18:15776:x1875495914405760:12345-0@lo:253:mount.lustre.0 Request processed in 60247us (60463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612663.882958:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788612663.883070:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8d85c8a-0380-4a63-8187-d0137cefd572:15776:1875495914405760:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788612663.883091:0:15776:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788612663.883095:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788612663.883115:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788612663.883117:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612663.883118:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612663.883120:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612663.883122:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612663.883123:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612663.883125:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612663.883127:0:15776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788612663.883153:0:15776:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788612663.888253:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788612663.888435:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788612663.888698:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788612663.889067:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788612663.889225:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788612663.889643:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788612663.890997:0:15776:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788612663.946525:0:15776:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788612663.946538:0:15776:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788612663.946578:0:15776:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788612663.946664:0:15776:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788612663.946680:0:15776:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788612663.946719:0:15776:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788612664.753802:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788612665.198592:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788612665.266057:0:14374:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788612665.266066:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff928e923eb800 from 8 10000000:01000000:0.0:1788612665.266073:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788612665.266131:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea7bde600/0xfc956d548af42a01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612665.266145:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ea7bde600/0xfc956d548af42a01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612665.266158:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ea7bde600/0xfc956d548af42a01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612665.266189:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914406272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612665.266289:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612665.266354:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e973ab900 going to sleep for 11 seconds 00000100:00100000:2.0:1788612665.267509:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914406272 00000100:00100000:2.0:1788612665.267524:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914406272 00000100:00100000:2.0:1788612665.267599:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788612665.267610:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+18:14374:x1875495914406272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612665.267628:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612665.267649:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928eacd12600/0xfc956d548af42a08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af42a01 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612665.267693:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928eacd12600/0xfc956d548af42a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af42a01 expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612665.269822:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928eacd12600/0xfc956d548af42a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af42a01 expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612665.269958:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928eacd12600, rc 0) 00000100:00100000:2.0:1788612665.270080:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+19:14374:x1875495914406272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2470us (3789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612665.270090:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788612665.271287:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914406272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612665.271320:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ea7bde600/0xfc956d548af42a01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42a08 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612665.271334:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ea7bde600/0xfc956d548af42a01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af42a08 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612665.271449:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914406400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788612665.271524:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612665.271591:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e973ab900 going to sleep for 11 seconds 00000100:00100000:1.0:1788612665.271678:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914406400 00000100:00100000:1.0:1788612665.271688:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914406400 00000100:00100000:1.0:1788612665.271754:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788612665.271765:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+19:14374:x1875495914406400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788612665.271794:0:14370:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788612665.271816:0:14370:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788612665.271819:0:14370:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788612665.271966:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+19:14374:x1875495914406400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 202us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612665.271974:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788612665.272013:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914406400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788612665.272082:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788612665.272092:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea7bde600/0xfc956d548af42a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42a08 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612665.272102:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ea7bde600/0xfc956d548af42a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42a08 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612665.772119:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612666.801611:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612667.820091:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612668.846307:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788612668.972980:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612668.972989:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788612668.972993:0:8:0:(import.c:65:import_set_state_nolock()) ffff928eacf4b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612668.973007:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff928eacf4b800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1788612668.973032:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff928eacd58a80 x1875495914406784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612668.973346:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8d85c8a-0380-4a63-8187-d0137cefd572:3306:1875495914406528:0@lo:400:kworker.0 00000100:00100000:0.0:1788612668.973412:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612668.973595:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914407168:0@lo:400:kworker.0 00000100:00100000:0.0:1788612668.973623:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612668.973650:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612668.973657:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914407040:0@lo:400:kworker.0 00000100:00100000:0.0:1788612668.973676:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612668.973816:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914406656:0@lo:400:kworker.0 00000100:00100000:0.0:1788612668.973865:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612668.973888:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612668.973894:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914406912:0@lo:400:kworker.0 00000100:00100000:0.0:1788612668.973915:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612668.973944:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914406784:0@lo:8:kworker.0 00000100:00100000:0.0:1788612668.973966:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612668.973998:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914406528 00000100:00100000:0.0:1788612668.974006:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914406528 00000100:00100000:0.0:1788612668.974060:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788612668.974079:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+19:3306:x1875495914406528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612668.974128:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+19:3306:x1875495914406528:12345-0@lo:400:kworker.0 Request processed in 61us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612668.974145:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788612668.974184:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914407168 00000100:00100000:0.0:1788612668.974188:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914407168 00000100:00100000:0.0:1788612668.974219:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914407040 00000100:00100000:0.0:1788612668.974222:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914407040 00000100:00100000:0.0:1788612668.974233:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914406912 00000100:00100000:0.0:1788612668.974234:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914406912 00000100:00100000:0.0:1788612668.974245:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612668.974250:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914407168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612668.974280:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875495914407168:12345-0@lo:400:kworker.0 Request processed in 30us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612668.974286:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612668.974296:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612668.974301:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875495914407040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612668.974323:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875495914407040:12345-0@lo:400:kworker.0 Request processed in 22us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612668.974328:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612668.974338:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612668.974342:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914406912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612668.974368:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914406912:12345-0@lo:400:kworker.0 Request processed in 26us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612668.974373:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612668.974397:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914406656 00000100:00100000:0.0:1788612668.974405:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914406656 00000100:00100000:0.0:1788612668.974443:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914406784 00000100:00100000:0.0:1788612668.974447:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914406784 00000100:00100000:0.0:1788612668.974457:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612668.974463:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914406656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612668.974931:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914406656:12345-0@lo:400:kworker.0 Request processed in 466us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612668.974938:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612668.974953:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788612668.974957:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1875495914406784:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788612668.974984:0:15062:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:0.0:1788612668.975010:0:15062:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfc956d548af42a0f 00002000:00100000:0.0:1788612668.975023:0:15062:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff928d849c5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788612668.975028:0:15062:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788612668.975030:0:15062:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788612668.975637:0:15062:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788612668.975663:0:15062:0:(import.c:65:import_set_state_nolock()) ffff928d849c7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612668.975907:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875495914406784:12345-0@lo:8:kworker.0 Request processed in 946us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612668.975915:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788612668.975952:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788612668.975957:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788612668.975992:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eacd58a80 x1875495914406784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788612668.976009:0:3304:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788612668.976017:0:3304:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788612668.976023:0:3304:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788612668.976033:0:3304:0:(import.c:65:import_set_state_nolock()) ffff928eacf4b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788612668.976055:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788612668.976061:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875495914406784:0@lo:8:kworker.0 00000004:00080000:0.0:1788612668.976094:0:14401:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788612668.977363:0:14402:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788612668.977452:0:14402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1875495914407424:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788612668.977512:0:14402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612668.977538:0:14402:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cd900 going to sleep for 11 seconds 00000100:00100000:3.0:1788612668.977575:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914407552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612668.977606:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612668.977627:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612668.977632:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914407296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612668.977648:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612668.977672:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914407552 00000100:00100000:3.0:1788612668.977678:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914407552 00000004:00080000:0.0:1788612668.977681:0:14401:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 462820842187ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788612668.977710:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914407296 00000100:00100000:3.0:1788612668.977713:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914407296 00010000:00080000:0.0:1788612668.977722:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eacd5ad80 x1875495914406912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612668.977734:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788612668.977735:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914406912:0@lo:400:kworker.0 00000100:00100000:3.0:1788612668.977741:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914407552:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612668.977747:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914406656:0@lo:400:kworker.0 00002000:00000024:3.0:1788612668.977770:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1788612668.977777:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eacd58e00 x1875495914407040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612668.977786:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875495914407040:0@lo:400:kworker.0 00000100:00100000:0.0:1788612668.977807:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8d85c8a-0380-4a63-8187-d0137cefd572:3306:1875495914406528:0@lo:400:kworker.0 00000100:00100000:3.0:1788612668.977819:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914407552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (212us total) trans 0 rc 0/0 00010000:00080000:0.0:1788612668.977821:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eacd58700 x1875495914407168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612668.977826:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788612668.977829:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875495914407168:0@lo:400:kworker.0 00000100:00100000:3.0:1788612668.977854:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612668.977860:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875495914407296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612668.977879:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612668.977903:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875495914407296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612668.977909:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788612668.980340:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eb7fce680 x1875495914407296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612668.980360:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914407296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612668.980371:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914407552:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788612668.980905:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612668.980932:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914407424 00000100:00100000:3.0:1788612668.980939:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914407424 00000100:00100000:3.0:1788612668.981016:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612668.981026:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14402:x1875495914407424:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788612668.983996:0:15062:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788612668.984007:0:15062:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788612668.984012:0:15062:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1788612669.004025:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788612669.004036:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007263843d/0xfc956d548af42a16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004050:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788612669.004054:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612669.004059:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007263843d/0xfc956d548af42a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004073:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007263843d/0xfc956d548af42a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004081:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007263843d/0xfc956d548af42a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004087:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007263843d/0xfc956d548af42a16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004105:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612669.004118:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.004122:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007263843d/0xfc956d548af42a16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004136:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928d8789f400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.004141:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007263843d/0xfc956d548af42a16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004151:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007263843d/0xfc956d548af42a16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004170:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007263843d/0xfc956d548af42a16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004178:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007263843d/0xfc956d548af42a16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004197:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.004198:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.004200:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788612669.004777:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788612669.004782:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cf94c7d/0xfc956d548af42a1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004789:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788612669.004791:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612669.004807:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cf94c7d/0xfc956d548af42a1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004818:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cf94c7d/0xfc956d548af42a1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004859:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cf94c7d/0xfc956d548af42a1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004867:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cf94c7d/0xfc956d548af42a1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004885:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612669.004895:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.004900:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cf94c7d/0xfc956d548af42a1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004906:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928d8789fa00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.004910:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cf94c7d/0xfc956d548af42a1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.004917:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cf94c7d/0xfc956d548af42a1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.005055:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cf94c7d/0xfc956d548af42a1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.005063:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cf94c7d/0xfc956d548af42a1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.005076:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.005083:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.005085:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788612669.007322:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788612669.007333:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000374196e8/0xfc956d548af42a24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.007350:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788612669.007354:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612669.007360:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000374196e8/0xfc956d548af42a24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.007487:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000374196e8/0xfc956d548af42a24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.007499:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000374196e8/0xfc956d548af42a24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.007508:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000374196e8/0xfc956d548af42a24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.007639:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612669.008124:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.008131:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b9d2dc9/0xfc956d548af42a2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.008142:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.008145:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.008150:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b9d2dc9/0xfc956d548af42a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.008162:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b9d2dc9/0xfc956d548af42a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.008170:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b9d2dc9/0xfc956d548af42a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.008188:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b9d2dc9/0xfc956d548af42a2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.008494:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612669.008502:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000374196e8/0xfc956d548af42a24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.008510:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928d8789ea00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.008515:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000374196e8/0xfc956d548af42a24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.008536:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000374196e8/0xfc956d548af42a24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.008553:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000374196e8/0xfc956d548af42a24 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.008561:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000374196e8/0xfc956d548af42a24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.008577:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.008581:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b9d2dc9/0xfc956d548af42a2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.008587:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.008590:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b9d2dc9/0xfc956d548af42a2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.008597:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b9d2dc9/0xfc956d548af42a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.008605:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b9d2dc9/0xfc956d548af42a2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.008612:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.008614:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.008621:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.008684:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612669.008690:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b9d2dc9/0xfc956d548af42a2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612669.009151:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.009156:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000756d0c82/0xfc956d548af42a32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.009166:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.009169:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.009174:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000756d0c82/0xfc956d548af42a32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.009184:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000756d0c82/0xfc956d548af42a32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.009192:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000756d0c82/0xfc956d548af42a32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.009199:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000756d0c82/0xfc956d548af42a32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.009544:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.009550:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000756d0c82/0xfc956d548af42a32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.009558:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.009562:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000756d0c82/0xfc956d548af42a32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.009570:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000756d0c82/0xfc956d548af42a32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.009583:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000756d0c82/0xfc956d548af42a32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.009592:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.009594:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.009595:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.009648:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612669.009653:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000756d0c82/0xfc956d548af42a32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612669.010139:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.010145:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c7ad7c/0xfc956d548af42a39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.010155:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.010159:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.010163:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c7ad7c/0xfc956d548af42a39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.010173:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042c7ad7c/0xfc956d548af42a39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.010181:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c7ad7c/0xfc956d548af42a39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.010188:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042c7ad7c/0xfc956d548af42a39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.010519:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.010526:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042c7ad7c/0xfc956d548af42a39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.010533:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13a00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.010536:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c7ad7c/0xfc956d548af42a39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.010545:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c7ad7c/0xfc956d548af42a39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.010571:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042c7ad7c/0xfc956d548af42a39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.010579:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.010581:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.010583:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.010641:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612669.010646:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042c7ad7c/0xfc956d548af42a39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612669.011108:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.011113:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a40b4225/0xfc956d548af42a40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.011123:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.011126:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.011130:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a40b4225/0xfc956d548af42a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.011140:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a40b4225/0xfc956d548af42a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.011148:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a40b4225/0xfc956d548af42a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.011155:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a40b4225/0xfc956d548af42a40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.011342:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.011348:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a40b4225/0xfc956d548af42a40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.011355:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12a00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.011359:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a40b4225/0xfc956d548af42a40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.011366:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a40b4225/0xfc956d548af42a40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.011386:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a40b4225/0xfc956d548af42a40 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.011495:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.011498:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.011499:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.011555:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612669.011560:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a40b4225/0xfc956d548af42a40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612669.012019:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.012025:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff219400/0xfc956d548af42a47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.012043:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.012047:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.012052:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff219400/0xfc956d548af42a47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.012061:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff219400/0xfc956d548af42a47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.012068:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff219400/0xfc956d548af42a47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.012075:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff219400/0xfc956d548af42a47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.012287:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.012293:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff219400/0xfc956d548af42a47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.012310:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd12c00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.012314:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff219400/0xfc956d548af42a47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.012322:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff219400/0xfc956d548af42a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.012332:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff219400/0xfc956d548af42a47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.012340:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.012342:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.012343:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.012514:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612669.012519:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff219400/0xfc956d548af42a47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612669.013104:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.013111:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095c31a92/0xfc956d548af42a4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.013120:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.013123:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.013129:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095c31a92/0xfc956d548af42a4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.013151:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095c31a92/0xfc956d548af42a4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.013160:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095c31a92/0xfc956d548af42a4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.013167:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095c31a92/0xfc956d548af42a4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.013546:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.013553:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095c31a92/0xfc956d548af42a4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.013560:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928eacd13200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.013564:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095c31a92/0xfc956d548af42a4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.013573:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095c31a92/0xfc956d548af42a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.013587:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095c31a92/0xfc956d548af42a4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.013602:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.013604:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.013606:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.014857:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788612669.014860:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.014868:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095c31a92/0xfc956d548af42a4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612669.018121:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.018136:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.018153:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.018158:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.018165:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.018179:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.018204:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.018488:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.018510:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612669.018524:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612669.018529:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.018537:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9c00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612669.018542:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.018551:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.018568:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.018575:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.018591:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.018599:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.018601:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612669.019710:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.019719:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42a5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.019732:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.019736:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.019742:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42a5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.019753:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42a5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.019761:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42a5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.019769:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42a5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.019792:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788612669.021036:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788612669.021067:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.021075:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42a5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.021085:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.021090:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42a5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.021100:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42a5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.021119:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42a5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.021127:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42a5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.021146:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.021148:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.021150:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612669.021507:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.021513:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42a63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.021524:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.021528:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.021534:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42a63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.021553:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42a63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.021562:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42a63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.021569:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42a63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.021626:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612669.022115:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.022121:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.022130:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.022133:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.022137:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.022146:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.022154:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.022172:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.022319:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612669.022326:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42a63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.022344:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.022347:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42a63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.022356:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42a63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.022370:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42a63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.022386:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42a63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.022463:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.022467:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.022474:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.022477:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.022486:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.022497:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a6a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.022511:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.022513:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.022515:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.022624:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612669.022629:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612669.023723:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.023732:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.023744:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.023747:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.023753:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.023763:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.023771:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.023778:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.023918:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.024039:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.024048:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9c00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.024052:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.024061:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.024075:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.024083:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.024085:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.024087:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.024156:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612669.024161:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4d3a88f/0xfc956d548af42a71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612669.024743:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.024749:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eb02d2c/0xfc956d548af42a78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.024759:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.024762:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.024766:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eb02d2c/0xfc956d548af42a78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.024775:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eb02d2c/0xfc956d548af42a78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.024782:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eb02d2c/0xfc956d548af42a78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.024789:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eb02d2c/0xfc956d548af42a78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.024830:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.024835:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eb02d2c/0xfc956d548af42a78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.024871:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.024874:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eb02d2c/0xfc956d548af42a78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.024889:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eb02d2c/0xfc956d548af42a78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.024901:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eb02d2c/0xfc956d548af42a78 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.024909:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.024911:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.024913:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.025073:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612669.025078:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eb02d2c/0xfc956d548af42a78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.025276:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612669.025667:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.025672:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.025681:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.025684:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.025688:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.025697:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.025705:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.025712:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.025759:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612669.026169:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.026175:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af42a86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.026184:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.026187:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.026198:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af42a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.026207:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af42a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.026228:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af42a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.026236:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af42a86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.026653:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612669.026660:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.026668:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.026671:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.026679:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.026694:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.026701:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b3ef671/0xfc956d548af42a7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.026729:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.026733:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af42a86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.026738:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9e00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.026741:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af42a86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.026748:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af42a86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.026758:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af42a86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.026766:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.026767:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.026769:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.026854:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612669.026859:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009788979f/0xfc956d548af42a86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612669.030717:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.030730:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e869da27/0xfc956d548af42a8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.030747:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.030752:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.030758:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e869da27/0xfc956d548af42a8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.030772:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e869da27/0xfc956d548af42a8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.030805:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e869da27/0xfc956d548af42a8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.030813:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e869da27/0xfc956d548af42a8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.031195:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.031219:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e869da27/0xfc956d548af42a8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.031229:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.031233:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e869da27/0xfc956d548af42a8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.031256:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e869da27/0xfc956d548af42a8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.031283:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e869da27/0xfc956d548af42a8d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.031294:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.031295:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.031298:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.031792:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612669.031807:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e869da27/0xfc956d548af42a8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612669.032761:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.032769:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d993e5b/0xfc956d548af42a94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.032781:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.032785:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.032791:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d993e5b/0xfc956d548af42a94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.032813:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d993e5b/0xfc956d548af42a94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.032822:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d993e5b/0xfc956d548af42a94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.032863:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d993e5b/0xfc956d548af42a94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.034515:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.034530:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d993e5b/0xfc956d548af42a94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.034542:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.034548:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d993e5b/0xfc956d548af42a94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.034560:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d993e5b/0xfc956d548af42a94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.034580:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d993e5b/0xfc956d548af42a94 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.034591:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.034592:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.034594:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.036133:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612669.036148:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d993e5b/0xfc956d548af42a94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.036357:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612669.037685:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.037694:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a643b827/0xfc956d548af42a9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.037709:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.037714:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.037720:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a643b827/0xfc956d548af42a9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.037734:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a643b827/0xfc956d548af42a9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.037743:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a643b827/0xfc956d548af42a9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.037750:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a643b827/0xfc956d548af42a9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.037832:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612669.038268:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.038274:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df5b8eec/0xfc956d548af42aa2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.038282:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.038285:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.038289:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df5b8eec/0xfc956d548af42aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.038297:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df5b8eec/0xfc956d548af42aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.038304:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df5b8eec/0xfc956d548af42aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.038311:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df5b8eec/0xfc956d548af42aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.038682:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612669.038691:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a643b827/0xfc956d548af42a9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.038699:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8800 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.038704:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a643b827/0xfc956d548af42a9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.038714:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a643b827/0xfc956d548af42a9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.038731:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a643b827/0xfc956d548af42a9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.038738:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a643b827/0xfc956d548af42a9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.038758:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.038761:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df5b8eec/0xfc956d548af42aa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.038767:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.038769:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df5b8eec/0xfc956d548af42aa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.038776:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df5b8eec/0xfc956d548af42aa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.038803:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df5b8eec/0xfc956d548af42aa2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.038812:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.038814:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.038816:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.040894:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612669.040907:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df5b8eec/0xfc956d548af42aa2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612669.041694:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.041701:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036a35e3f/0xfc956d548af42aa9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.041721:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.041726:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.041732:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036a35e3f/0xfc956d548af42aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.041747:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036a35e3f/0xfc956d548af42aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.041758:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036a35e3f/0xfc956d548af42aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.041765:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036a35e3f/0xfc956d548af42aa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.042055:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.042062:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036a35e3f/0xfc956d548af42aa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.042071:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8000 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.042076:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036a35e3f/0xfc956d548af42aa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.042084:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036a35e3f/0xfc956d548af42aa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.042101:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036a35e3f/0xfc956d548af42aa9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.042110:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.042112:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.042114:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.042175:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612669.042181:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036a35e3f/0xfc956d548af42aa9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.042500:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612669.044128:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.044138:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000248381db/0xfc956d548af42ab0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.044152:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.044155:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.044161:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000248381db/0xfc956d548af42ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.044184:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000248381db/0xfc956d548af42ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.044194:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000248381db/0xfc956d548af42ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.044308:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000248381db/0xfc956d548af42ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.044334:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612669.044405:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612669.044421:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000248381db/0xfc956d548af42ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612669.044741:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8e00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612669.044745:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000248381db/0xfc956d548af42ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612669.044759:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000248381db/0xfc956d548af42ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612669.044777:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000248381db/0xfc956d548af42ab0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612669.044784:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000248381db/0xfc956d548af42ab0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612669.044812:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612669.044814:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612669.044816:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612669.046035:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.046046:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af42ab7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.046060:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.046065:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.046070:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af42ab7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.046082:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af42ab7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.046091:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af42ab7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.046109:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af42ab7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.046130:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612669.046371:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.046487:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af42ab7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.046501:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9a00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.046505:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af42ab7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.046513:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af42ab7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.046529:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af42ab7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.046536:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c438f9/0xfc956d548af42ab7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.046553:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.046555:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.046557:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612669.047194:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.047333:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8f22c8/0xfc956d548af42abe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.047346:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.047351:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.047357:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8f22c8/0xfc956d548af42abe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.047370:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee8f22c8/0xfc956d548af42abe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.047515:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8f22c8/0xfc956d548af42abe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.047523:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8f22c8/0xfc956d548af42abe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.047597:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612669.048020:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.048028:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee8f22c8/0xfc956d548af42abe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.048036:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8c00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.048040:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8f22c8/0xfc956d548af42abe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.048051:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8f22c8/0xfc956d548af42abe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.048073:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee8f22c8/0xfc956d548af42abe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.048082:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee8f22c8/0xfc956d548af42abe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.048102:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.048104:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.048106:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612669.048578:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.048585:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42ac5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.048602:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.048606:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.048612:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42ac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.048623:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42ac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.048632:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42ac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.048639:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42ac5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.048698:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612669.049158:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788612669.049164:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42acc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.049173:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788612669.049177:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612669.049181:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42acc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.049190:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42acc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.049225:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42acc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612669.049232:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42acc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.049602:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612669.049609:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42ac5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.049617:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.049621:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42ac5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.049629:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42ac5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.049643:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42ac5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.049650:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcff5b0f/0xfc956d548af42ac5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.049680:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612669.049683:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42acc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.049690:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612669.049693:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42acc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.049701:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42acc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.049712:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42acc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.049719:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.049720:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612669.049722:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612669.049777:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612669.049782:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa72662f/0xfc956d548af42acc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612669.050053:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788612669.050191:0:15062:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1788612669.050530:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14402:x1875495914407424:12345-0@lo:5:osp-pre-1-0.0 Request processed in 69501us (73014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612669.050540:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612669.055320:0:14402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1875495914407424:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788612669.055343:0:14402:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788612669.055764:0:14402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1875495914407680:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788612669.055834:0:14402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612669.055886:0:14402:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cd900 going to sleep for 11 seconds 00000100:00100000:1.0:1788612669.056085:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914407680 00000100:00100000:1.0:1788612669.056094:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914407680 00000100:00100000:1.0:1788612669.056144:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788612669.056153:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14402:x1875495914407680:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788612669.056204:0:15061:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788612669.064789:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14402:x1875495914407680:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8629us (8947us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788612669.064821:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788612669.065044:0:14402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1875495914407680:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788612669.065061:0:14402:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1788612669.877724:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612670.893760:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788612671.799529:0:16131:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788612671.918440:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612672.941684:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612673.964265:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612674.092010:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612674.092031:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914407808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612674.092092:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612674.092154:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914407808 00000100:00100000:3.0:1788612674.092161:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914407808 00000100:00100000:3.0:1788612674.092210:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612674.092219:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914407808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612674.092256:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612674.092299:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875495914407808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612674.092306:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788612674.092327:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612674.092378:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875495914407808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612674.092653:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612674.092662:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914407936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612674.092685:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612674.093870:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914407936 00000100:00100000:3.0:1788612674.093881:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914407936 00000100:00100000:3.0:1788612674.093926:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612674.093935:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875495914407936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612674.093962:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612674.094017:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875495914407936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612674.094024:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788612674.094042:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612674.094076:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914407936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612674.107207:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8d85c8a-0380-4a63-8187-d0137cefd572:3307:1875495914408064:0@lo:400:kworker.0 00000100:00100000:3.0:1788612674.107279:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612674.107337:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914408064 00000100:00100000:3.0:1788612674.107345:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914408064 00000100:00100000:3.0:1788612674.107389:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788612674.107397:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+19:3307:x1875495914408064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612674.107442:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+19:3307:x1875495914408064:12345-0@lo:400:kworker.0 Request processed in 46us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612674.107448:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788612674.107491:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8d85c8a-0380-4a63-8187-d0137cefd572:3307:1875495914408064:0@lo:400:kworker.0 00000100:00100000:3.0:1788612674.107523:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914408192:0@lo:400:kworker.0 00000100:00100000:3.0:1788612674.107549:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612674.107579:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914408192 00000100:00100000:3.0:1788612674.107583:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914408192 00000100:00100000:3.0:1788612674.107607:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788612674.107615:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914408192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612674.107650:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914408192:12345-0@lo:400:kworker.0 Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612674.107657:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788612674.107684:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eb7fce680 x1875495914408192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612674.107697:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914408192:0@lo:400:kworker.0 00000100:00100000:3.0:1788612674.107728:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914408320:0@lo:400:kworker.0 00000100:00100000:3.0:1788612674.107764:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612674.107800:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914408320 00000100:00100000:3.0:1788612674.107805:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914408320 00000100:00100000:3.0:1788612674.107833:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788612674.107865:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914408320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612674.107899:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914408320:12345-0@lo:400:kworker.0 Request processed in 60us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612674.107904:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788612674.107919:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788612674.107946:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eb7fce680 x1875495914408320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612674.107956:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914408320:0@lo:400:kworker.0 00000100:00100000:3.0:1788612674.107997:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612674.108005:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914408448:0@lo:400:kworker.0 00000100:00100000:3.0:1788612674.108030:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612674.108054:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914408448 00000100:00100000:3.0:1788612674.108057:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914408448 00000100:00100000:3.0:1788612674.108081:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788612674.108087:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914408448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612674.108119:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914408448:12345-0@lo:400:kworker.0 Request processed in 32us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612674.108125:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788612674.108137:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788612674.108153:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff928eb7fce680 x1875495914408448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612674.108161:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914408448:0@lo:400:kworker.0 00000001:00100000:1.0:1788612674.187570:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788612674.187639:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:1.0:1788612674.407719:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612674.407980:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893442688 00000100:00100000:0.0:1788612674.407992:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893442688 00000100:00100000:0.0:1788612674.408043:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:0.0:1788612674.408052:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1875495893442688:12345-192.168.202.6@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788612674.408083:0:14370:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from de248df6-b80e-4f4c-babe-3ba2189953f0@192.168.202.6@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:0.0:1788612674.408118:0:14370:0:(genops.c:1385:class_connect()) connect: client de248df6-b80e-4f4c-babe-3ba2189953f0, cookie 0xfc956d548af42ad3 00000100:00080000:0.0:1788612674.408249:0:14370:0:(import.c:65:import_set_state_nolock()) ffff928d8505a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612674.408331:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+5:2352:x1875495893442688:12345-192.168.202.6@tcp:250:mount.lustre.0 Request processed in 278us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612674.408339:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:0.0:1788612674.411200:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612674.416108:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893442816 00000100:00100000:3.0:1788612674.416144:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893442816 00000100:00100000:2.0:1788612674.430571:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:2.0:1788612674.430588:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+5:13740:x1875495893442816:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788612674.430609:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612674.430636:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e8200/0xfc956d548af42ada lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc62 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612674.430704:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e8200/0xfc956d548af42ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc62 expref: 6 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612674.430718:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e8200/0xfc956d548af42ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc62 expref: 6 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612674.430737:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8200, rc 0) 00000100:00100000:2.0:1788612674.430873:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+6:13740:x1875495893442816:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 252us (19646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612674.430881:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:1.0:1788612674.440969:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612674.441060:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893442944 00000100:00100000:3.0:1788612674.441081:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893442944 00000100:00100000:3.0:1788612674.441141:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:3.0:1788612674.441151:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+6:13740:x1875495893442944:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788612674.441517:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+6:13740:x1875495893442944:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 365us (558us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788612674.441525:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:1.0:1788612674.445669:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612674.447003:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893443072 00000100:00100000:0.0:1788612674.447018:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893443072 00000100:00100000:0.0:1788612674.447086:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:0.0:1788612674.447096:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+6:13740:x1875495893443072:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788612674.447113:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612674.447132:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea7bdea00/0xfc956d548af42ae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc69 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612674.448021:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea7bdea00/0xfc956d548af42ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc69 expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612674.448045:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea7bdea00/0xfc956d548af42ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc69 expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612674.448056:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdea00, rc 0) 00000100:00100000:0.0:1788612674.448127:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+7:13740:x1875495893443072:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 1032us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612674.448134:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:0.0:1788612674.451496:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612674.451600:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893443200 00000100:00100000:3.0:1788612674.451615:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893443200 00000100:00100000:3.0:1788612674.451680:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:3.0:1788612674.451693:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+7:13740:x1875495893443200:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788612674.452553:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+8:13740:x1875495893443200:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 858us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612674.452564:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:1.0:1788612674.456040:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612674.456299:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893443328 00000100:00100000:0.0:1788612674.456309:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893443328 00000100:00100000:0.0:1788612674.456429:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:0.0:1788612674.456441:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+8:13740:x1875495893443328:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788612674.456767:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+8:13740:x1875495893443328:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 319us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612674.456775:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:1.0:1788612674.460154:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612674.460685:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893443456 00000100:00100000:3.0:1788612674.460696:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893443456 00000100:00100000:3.0:1788612674.460763:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:3.0:1788612674.460774:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+8:13759:x1875495893443456:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788612674.461276:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+8:13759:x1875495893443456:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 503us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612674.461285:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:3.0:1788612674.505609:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612674.505773:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893443584 00000100:00100000:2.0:1788612674.505783:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893443584 00000100:00100000:2.0:1788612674.505883:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00100000:2.0:1788612674.505894:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+8:13759:x1875495893443584:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612674.506182:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+8:13759:x1875495893443584:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 289us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612674.506190:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00100000:1.0:1788612674.514285:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612674.514380:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893443712 00000100:00100000:0.0:1788612674.514405:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893443712 00000100:00100000:0.0:1788612674.514465:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:0.0:1788612674.514476:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+8:13740:x1875495893443712:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788612674.514492:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612674.514509:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea7bde000/0xfc956d548af42ae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc93 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612674.514538:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea7bde000/0xfc956d548af42ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc93 expref: 9 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612674.514549:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea7bde000/0xfc956d548af42ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc93 expref: 9 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612674.514557:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bde000, rc 0) 00000100:00100000:0.0:1788612674.514618:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+9:13740:x1875495893443712:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 144us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612674.514625:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:1.0:1788612674.527717:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612674.527802:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893443840 00000100:00100000:3.0:1788612674.527813:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893443840 00000100:00100000:3.0:1788612674.527906:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:3.0:1788612674.527916:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+9:13740:x1875495893443840:12345-192.168.202.6@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788612674.527955:0:14372:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788612674.527975:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788612674.527980:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788612674.527982:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788612674.527985:0:14372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788612674.532788:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+9:13740:x1875495893443840:12345-192.168.202.6@tcp:256:mount.lustre.0 Request processed in 4862us (5069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612674.532803:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:1.0:1788612674.536446:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612674.536647:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893443968 00000100:00100000:2.0:1788612674.536658:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893443968 00000100:00100000:2.0:1788612674.536776:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:2.0:1788612674.536788:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+9:13740:x1875495893443968:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788612674.536808:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612674.536884:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ec21e9800/0xfc956d548af42aef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddc9a expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612674.536916:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ec21e9800/0xfc956d548af42aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc9a expref: 10 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612674.536942:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ec21e9800/0xfc956d548af42aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc9a expref: 10 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612674.536953:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9800, rc 0) 00000100:00100000:2.0:1788612674.537022:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+10:13740:x1875495893443968:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 236us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612674.537029:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:1.0:1788612674.540586:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612674.540779:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893444096 00000100:00100000:0.0:1788612674.540791:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893444096 00000100:00100000:0.0:1788612674.540997:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:0.0:1788612674.541009:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+10:13740:x1875495893444096:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788612674.541638:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+10:13740:x1875495893444096:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 629us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612674.541648:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:3.0:1788612674.543641:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612674.543744:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893444224 00000100:00100000:2.0:1788612674.543753:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893444224 00000100:00100000:2.0:1788612674.544010:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:2.0:1788612674.544021:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+10:13740:x1875495893444224:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788612674.544418:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+10:13740:x1875495893444224:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 398us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612674.544426:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:1.0:1788612674.552481:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612674.553625:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893444352 00000100:00100000:0.0:1788612674.553637:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893444352 00000100:00100000:0.0:1788612674.553751:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:0.0:1788612674.553762:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+10:13766:x1875495893444352:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612674.554115:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+10:13766:x1875495893444352:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 354us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612674.554125:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:3.0:1788612674.561689:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612674.568446:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893444480 00000100:00100000:1.0:1788612674.568466:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893444480 00000100:00100000:1.0:1788612674.568532:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 90 00000100:00100000:1.0:1788612674.568543:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacc9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+10:13766:x1875495893444480:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788612674.572632:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacc9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+10:13766:x1875495893444480:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 4081us (10943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612674.572658:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 90 00000100:00100000:3.0:1788612674.594507:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612674.594876:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893444608 00000100:00100000:0.0:1788612674.594887:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893444608 00000100:00100000:0.0:1788612674.594937:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:0.0:1788612674.594947:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1875495893444608:12345-192.168.202.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788612674.594979:0:14379:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a69c66e5-135a-4565-b61a-424712bcbd1e@192.168.202.6@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:0.0:1788612674.595031:0:14379:0:(genops.c:1385:class_connect()) connect: client a69c66e5-135a-4565-b61a-424712bcbd1e, cookie 0xfc956d548af42af6 00000004:00100000:0.0:1788612674.595064:0:14379:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788612674.595077:0:14379:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788612674.635514:0:14379:0:(import.c:65:import_set_state_nolock()) ffff928d849c0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612674.635713:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+6:2352:x1875495893444608:12345-192.168.202.6@tcp:38:mount.lustre.0 Request processed in 40763us (41213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612674.635732:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:1.0:1788612674.639292:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612674.639474:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612674.640154:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893444736 00000100:00100000:3.0:1788612674.640165:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893444736 00000100:00080000:0.0:1788612674.640289:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612674.640335:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893444864 00000100:00100000:3.0:1788612674.640340:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893444864 00000100:00100000:1.0:1788612674.640433:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1788612674.640445:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+7:0:x1875495893444736:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788612674.640490:0:14379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788612674.640620:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+7:0:x1875495893444736:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 177us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612674.640628:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1788612674.640646:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:1.0:1788612674.640654:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+6:13740:x1875495893444864:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788612674.640666:0:14379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788612674.640690:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+6:13740:x1875495893444864:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 38us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612674.640696:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:1.0:1788612674.643594:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612674.643680:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893444992 00000100:00100000:2.0:1788612674.643690:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893444992 00000100:00100000:2.0:1788612674.643767:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:2.0:1788612674.643776:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+6:13740:x1875495893444992:12345-192.168.202.6@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788612674.643900:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+6:13740:x1875495893444992:12345-192.168.202.6@tcp:40:mount.lustre.0 Request processed in 124us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612674.643909:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:0.0:1788612674.646697:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612674.646761:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612674.646820:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612674.647054:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893445376 00000100:00100000:2.0:1788612674.647069:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893445376 00000100:00100000:2.0:1788612674.647122:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:2.0:1788612674.647133:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+6:13740:x1875495893445376:12345-192.168.202.6@tcp:33:mount.lustre.0 00000100:00100000:3.0:1788612674.647640:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893445120 00000100:00100000:3.0:1788612674.647646:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893445120 00000100:00100000:3.0:1788612674.647677:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893445248 00000100:00100000:3.0:1788612674.647680:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893445248 00000100:00100000:3.0:1788612674.647693:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:3.0:1788612674.647699:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875495893445120:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788612674.647735:0:15059:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a69c66e5-135a-4565-b61a-424712bcbd1e@192.168.202.6@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:3.0:1788612674.647769:0:15059:0:(genops.c:1385:class_connect()) connect: client a69c66e5-135a-4565-b61a-424712bcbd1e, cookie 0xfc956d548af42afd 00002000:00100000:3.0:1788612674.647781:0:15059:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a69c66e5-135a-4565-b61a-424712bcbd1e/ffff928d864aa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788612674.647791:0:15059:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788612674.648178:0:15059:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788612674.648211:0:15059:0:(import.c:65:import_set_state_nolock()) ffff928d864ae800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612674.648278:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+6:2352:x1875495893445120:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 578us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612674.648287:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:3.0:1788612674.648319:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:3.0:1788612674.648485:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875495893445248:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788612674.648506:0:15059:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a69c66e5-135a-4565-b61a-424712bcbd1e@192.168.202.6@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:3.0:1788612674.648525:0:15059:0:(genops.c:1385:class_connect()) connect: client a69c66e5-135a-4565-b61a-424712bcbd1e, cookie 0xfc956d548af42b04 00002000:00100000:3.0:1788612674.648531:0:15059:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a69c66e5-135a-4565-b61a-424712bcbd1e/ffff928d864ac000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788612674.648538:0:15059:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788612674.648760:0:15059:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788612674.648778:0:15059:0:(import.c:65:import_set_state_nolock()) ffff928d864af000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612674.648806:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+6:2352:x1875495893445248:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 481us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612674.648813:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000004:00080000:0.0:1788612674.652010:0:14380:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4795us 00000004:00200000:3.0:1788612674.668786:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788612674.668965:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+6:13740:x1875495893445376:12345-192.168.202.6@tcp:33:mount.lustre.0 Request processed in 21825us (22270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612674.668980:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:0.0:1788612674.828433:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612674.828625:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893445504 00000100:00100000:1.0:1788612674.828636:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893445504 00000100:00100000:1.0:1788612674.828791:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:1.0:1788612674.828802:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+6:13787:x1875495893445504:12345-192.168.202.6@tcp:101:mkdir.0 00010000:00010000:1.0:1788612674.828822:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612674.828894:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42b0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddcc4 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612674.828976:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61e00/0xfc956d548af42b12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612674.828991:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61e00/0xfc956d548af42b12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612674.829005:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61e00/0xfc956d548af42b12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612674.829038:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788612674.829041:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788612674.829086:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61e00/0xfc956d548af42b12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612674.829109:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42b0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddcc4 expref: 8 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612674.829127:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61e00/0xfc956d548af42b12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddcc4 expref: 7 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612674.829136:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e838ce300) 00010000:00010000:1.0:1788612674.829139:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612674.829143:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61e00, rc 0) 00000100:00100000:1.0:1788612674.829206:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+7:13787:x1875495893445504:12345-192.168.202.6@tcp:101:mkdir.0 Request processed in 406us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612674.829212:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00010000:00010000:0.0:1788612674.989609:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788612675.439505:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788612676.012401:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612676.934564:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612676.934690:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893445632 00000100:00100000:3.0:1788612676.934764:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893445632 00000100:00100000:3.0:1788612676.934912:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:3.0:1788612676.934924:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+7:13839:x1875495893445632:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:3.0:1788612676.934966:0:14377:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788612676.935069:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+7:13839:x1875495893445632:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 148us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612676.935076:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00080000:0.0:1788612676.935396:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612676.940790:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612676.940950:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893445760 00000100:00100000:0.0:1788612676.940962:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893445760 00000100:00100000:0.0:1788612676.941046:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:0.0:1788612676.941064:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eb7fcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a69c66e5-135a-4565-b61a-424712bcbd1e+6:13839:x1875495893445760:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:0.0:1788612676.941107:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612676.941201:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eb7fcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a69c66e5-135a-4565-b61a-424712bcbd1e+6:13839:x1875495893445760:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 145us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612676.941209:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00080000:3.0:1788612676.943917:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612676.944217:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612676.944420:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893445888 00000100:00100000:0.0:1788612676.944430:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893445888 00000100:00100000:0.0:1788612676.944502:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:0.0:1788612676.944512:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a69c66e5-135a-4565-b61a-424712bcbd1e+6:13839:x1875495893445888:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:0.0:1788612676.944658:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612676.944776:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a69c66e5-135a-4565-b61a-424712bcbd1e+6:13839:x1875495893445888:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 258us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612676.944784:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00080000:3.0:1788612676.946251:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788612677.043165:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612677.123872:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612677.123976:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893446016 00000100:00100000:1.0:1788612677.124007:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893446016 00000100:00100000:1.0:1788612677.124089:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:1.0:1788612677.124101:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+10:13870:x1875495893446016:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788612677.124120:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612677.124139:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928e90b61c00/0xfc956d548af42b19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddccb expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612677.124170:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928e90b61c00/0xfc956d548af42b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddccb expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612677.124181:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928e90b61c00/0xfc956d548af42b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddccb expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612677.124190:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61c00, rc 0) 00000100:00100000:1.0:1788612677.124258:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+11:13870:x1875495893446016:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 159us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612677.124266:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:1.0:1788612677.136062:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612677.138162:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893446144 00000100:00100000:0.0:1788612677.138180:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893446144 00000100:00100000:0.0:1788612677.138259:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:0.0:1788612677.138271:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+11:13870:x1875495893446144:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788612677.138611:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+11:13870:x1875495893446144:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 341us (2559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612677.138620:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:2.0:1788612677.144264:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612677.144489:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893446272 00000100:00100000:3.0:1788612677.144500:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893446272 00000100:00100000:3.0:1788612677.144641:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 93 00000100:00100000:3.0:1788612677.144652:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+11:13870:x1875495893446272:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788612677.145759:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+11:13870:x1875495893446272:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 1101us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612677.145770:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 93 00000100:00100000:2.0:1788612677.158135:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612677.158257:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893446400 00000100:00100000:0.0:1788612677.158267:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893446400 00000100:00100000:0.0:1788612677.158380:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 94 00000100:00100000:0.0:1788612677.158391:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+11:13878:x1875495893446400:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612677.158664:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+11:13878:x1875495893446400:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 274us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612677.158673:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 94 00000100:00100000:1.0:1788612677.190325:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612677.190429:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893446528 00000100:00100000:3.0:1788612677.190441:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893446528 00000100:00100000:3.0:1788612677.190497:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 95 00000100:00100000:3.0:1788612677.190508:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+11:13878:x1875495893446528:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788612677.190815:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+11:13878:x1875495893446528:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 307us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612677.190823:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 95 00000100:00100000:1.0:1788612677.195164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612677.195323:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893446656 00000100:00100000:0.0:1788612677.195334:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893446656 00000100:00100000:0.0:1788612677.195388:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:0.0:1788612677.195399:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+11:13870:x1875495893446656:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788612677.195560:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612677.195576:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea7bdfa00/0xfc956d548af42b20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddcf5 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612677.195600:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea7bdfa00/0xfc956d548af42b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddcf5 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612677.195607:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea7bdfa00/0xfc956d548af42b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddcf5 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612677.195613:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdfa00, rc 0) 00000100:00100000:0.0:1788612677.195660:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+12:13870:x1875495893446656:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 262us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612677.195667:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 96 00000100:00100000:2.0:1788612677.205325:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612677.205373:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893446784 00000100:00100000:1.0:1788612677.205384:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893446784 00000100:00100000:1.0:1788612677.206811:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:1.0:1788612677.207266:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+12:13870:x1875495893446784:12345-192.168.202.6@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788612677.207296:0:14370:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788612677.207316:0:14370:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788612677.207320:0:14370:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788612677.207323:0:14370:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788612677.207331:0:14370:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788612677.208936:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+12:13870:x1875495893446784:12345-192.168.202.6@tcp:256:mount.lustre.0 Request processed in 2101us (3609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612677.209411:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 97 00000100:00100000:2.0:1788612677.213347:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612677.213497:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893446912 00000100:00100000:0.0:1788612677.213509:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893446912 00000100:00100000:0.0:1788612677.213570:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 98 00000100:00100000:0.0:1788612677.213591:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+12:13870:x1875495893446912:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788612677.213608:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612677.213626:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea7bdee00/0xfc956d548af42b27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddcfc expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612677.213651:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea7bdee00/0xfc956d548af42b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddcfc expref: 13 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612677.213659:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea7bdee00/0xfc956d548af42b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddcfc expref: 13 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612677.213666:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdee00, rc 0) 00000100:00100000:0.0:1788612677.213777:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+13:13870:x1875495893446912:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 187us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612677.213784:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 98 00000100:00100000:1.0:1788612677.217790:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612677.217999:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893447040 00000100:00100000:2.0:1788612677.218009:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893447040 00000100:00100000:2.0:1788612677.218123:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 99 00000100:00100000:2.0:1788612677.218135:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+13:13870:x1875495893447040:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788612677.218387:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+13:13870:x1875495893447040:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 253us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612677.218397:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 99 00000100:00100000:0.0:1788612677.220458:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612677.220504:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893447168 00000100:00100000:2.0:1788612677.220513:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893447168 00000100:00100000:2.0:1788612677.220623:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 100 00000100:00100000:2.0:1788612677.220634:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+13:13870:x1875495893447168:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788612677.221023:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+13:13870:x1875495893447168:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 390us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612677.221041:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 100 00000001:00100000:2.0:1788612677.223926:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a69c66e5-135a-4565-b61a-424712bcbd1e 00000100:00100000:3.0:1788612677.224562:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612677.224648:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893447296 00000100:00100000:2.0:1788612677.224659:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893447296 00000100:00100000:2.0:1788612677.224722:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00100000:2.0:1788612677.224731:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+13:13882:x1875495893447296:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612677.224988:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+13:13882:x1875495893447296:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 257us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612677.225000:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 101 00000100:00100000:0.0:1788612677.230922:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612677.231524:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893447424 00000100:00100000:2.0:1788612677.231537:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893447424 00000100:00100000:2.0:1788612677.231598:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 102 00000100:00100000:2.0:1788612677.231607:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+13:13882:x1875495893447424:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612677.231982:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+13:13882:x1875495893447424:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 374us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612677.232001:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 102 00000100:00100000:0.0:1788612677.241026:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612677.241062:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612677.241093:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612677.241132:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612677.241385:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893447680 00000100:00100000:1.0:1788612677.241395:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893447680 00000100:00100000:1.0:1788612677.241454:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893447552 00000100:00100000:1.0:1788612677.241457:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893447552 00000100:00100000:1.0:1788612677.241474:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:1.0:1788612677.241485:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+7:2353:x1875495893447680:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612677.241568:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+7:2353:x1875495893447680:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 84us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612677.241577:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:1.0:1788612677.241595:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1788612677.241600:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1875495893447552:12345-192.168.202.6@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788612677.241626:0:14379:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4888723e-f23f-4213-998f-bea11838d5b1@192.168.202.6@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1788612677.241672:0:14379:0:(genops.c:1385:class_connect()) connect: client 4888723e-f23f-4213-998f-bea11838d5b1, cookie 0xfc956d548af42b2e 00000004:00100000:1.0:1788612677.241716:0:14379:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788612677.241867:0:14379:0:(import.c:65:import_set_state_nolock()) ffff928e90c65000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612677.241902:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4888723e-f23f-4213-998f-bea11838d5b1+6:2352:x1875495893447552:12345-192.168.202.6@tcp:38:mount.lustre.0 Request processed in 300us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612677.241909:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1788612677.241931:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893447936 00000100:00100000:1.0:1788612677.241935:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893447936 00000100:00100000:1.0:1788612677.241958:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893447808 00000100:00100000:1.0:1788612677.241961:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893447808 00000100:00100000:1.0:1788612677.241975:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:1.0:1788612677.241981:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+6:2353:x1875495893447936:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612677.242026:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+6:2353:x1875495893447936:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 44us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612677.242046:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:1.0:1788612677.242060:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:1.0:1788612677.242066:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2353:x1875495893447808:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612677.242093:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2353:x1875495893447808:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 28us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612677.242100:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:2.0:1788612677.245974:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612677.246181:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893448192 00000100:00100000:1.0:1788612677.246191:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893448192 00000100:00100000:1.0:1788612677.246278:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1788612677.246290:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4888723e-f23f-4213-998f-bea11838d5b1+6:13870:x1875495893448192:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788612677.246336:0:14379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788612677.246407:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4888723e-f23f-4213-998f-bea11838d5b1+6:13870:x1875495893448192:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 119us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612677.246414:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00080000:3.0:1788612677.246877:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612677.247436:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612677.247596:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893448064 00000100:00100000:0.0:1788612677.247604:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893448064 00000100:00100000:0.0:1788612677.247650:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:0.0:1788612677.247659:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4888723e-f23f-4213-998f-bea11838d5b1+6:0:x1875495893448064:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788612677.247683:0:14378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788612677.247804:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4888723e-f23f-4213-998f-bea11838d5b1+6:0:x1875495893448064:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 145us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612677.247857:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:0.0:1788612677.251103:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612677.251210:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893448320 00000100:00100000:2.0:1788612677.251220:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893448320 00000100:00100000:2.0:1788612677.251377:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:2.0:1788612677.251390:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4888723e-f23f-4213-998f-bea11838d5b1+6:13870:x1875495893448320:12345-192.168.202.6@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788612677.251491:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4888723e-f23f-4213-998f-bea11838d5b1+6:13870:x1875495893448320:12345-192.168.202.6@tcp:40:mount.lustre.0 Request processed in 103us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612677.251499:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:2.0:1788612677.255373:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612677.255458:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612677.255489:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612677.255551:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893448704 00000100:00100000:0.0:1788612677.255562:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893448704 00000100:00100000:0.0:1788612677.255614:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:0.0:1788612677.255622:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4888723e-f23f-4213-998f-bea11838d5b1+6:13870:x1875495893448704:12345-192.168.202.6@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788612677.255685:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788612677.255880:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4888723e-f23f-4213-998f-bea11838d5b1+6:13870:x1875495893448704:12345-192.168.202.6@tcp:33:mount.lustre.0 Request processed in 258us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612677.255888:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:1.0:1788612677.256576:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893448448 00000100:00100000:1.0:1788612677.256583:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893448448 00000100:00100000:3.0:1788612677.256653:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893448576 00000100:00100000:3.0:1788612677.256659:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893448576 00000100:00100000:1.0:1788612677.256664:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1788612677.256671:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875495893448448:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788612677.256711:0:15062:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4888723e-f23f-4213-998f-bea11838d5b1@192.168.202.6@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1788612677.256746:0:15062:0:(genops.c:1385:class_connect()) connect: client 4888723e-f23f-4213-998f-bea11838d5b1, cookie 0xfc956d548af42b35 00002000:00100000:1.0:1788612677.256760:0:15062:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4888723e-f23f-4213-998f-bea11838d5b1/ffff928e82dcb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788612677.256771:0:15062:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788612677.257186:0:15062:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788612677.257216:0:15062:0:(import.c:65:import_set_state_nolock()) ffff928e82dc9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612677.257278:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4888723e-f23f-4213-998f-bea11838d5b1+6:2352:x1875495893448448:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 605us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612677.257286:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:1.0:1788612677.257304:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1788612677.257309:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875495893448576:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788612677.257325:0:15062:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4888723e-f23f-4213-998f-bea11838d5b1@192.168.202.6@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1788612677.257342:0:15062:0:(genops.c:1385:class_connect()) connect: client 4888723e-f23f-4213-998f-bea11838d5b1, cookie 0xfc956d548af42b3c 00002000:00100000:1.0:1788612677.257347:0:15062:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4888723e-f23f-4213-998f-bea11838d5b1/ffff928e91953800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788612677.257353:0:15062:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788612677.257419:0:15062:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788612677.257438:0:15062:0:(import.c:65:import_set_state_nolock()) ffff928ec00fe800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612677.257461:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4888723e-f23f-4213-998f-bea11838d5b1+6:2352:x1875495893448576:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 151us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612677.257468:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:0.0:1788612677.406064:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612677.406456:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893448832 00000100:00100000:1.0:1788612677.406467:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893448832 00000100:00100000:1.0:1788612677.406532:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:1.0:1788612677.406544:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4888723e-f23f-4213-998f-bea11838d5b1+6:13903:x1875495893448832:12345-192.168.202.6@tcp:101:mkdir.0 00010000:00010000:1.0:1788612677.406564:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612677.406585:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61200/0xfc956d548af42b43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd26 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612677.406657:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42b4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612677.406700:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42b4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612677.406717:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42b4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612677.406760:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788612677.406764:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788612677.406785:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42b4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612677.406821:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61200/0xfc956d548af42b43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd26 expref: 8 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612677.407014:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42b4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd26 expref: 7 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612677.407024:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e838ce300) 00010000:00010000:1.0:1788612677.407027:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612677.407031:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e90b61800, rc 0) 00000100:00100000:1.0:1788612677.407562:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4888723e-f23f-4213-998f-bea11838d5b1+7:13903:x1875495893448832:12345-192.168.202.6@tcp:101:mkdir.0 Request processed in 1018us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612677.407571:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00010000:00010000:2.0:1788612678.060129:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612679.084000:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612679.212288:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914408576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612679.212367:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612679.212546:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914408704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612679.212577:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612679.212912:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914408576 00000100:00100000:2.0:1788612679.212921:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914408576 00000100:00100000:2.0:1788612679.212981:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914408704 00000100:00100000:2.0:1788612679.212985:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914408704 00000100:00080000:3.0:1788612679.213194:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788612679.213200:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612679.213400:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612679.213412:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914408576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612679.213450:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612679.213502:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914408576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612679.213509:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612679.213527:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612679.213534:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914408704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612679.213551:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788612679.213584:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914408704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612679.213589:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612679.213626:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788612679.213648:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914408704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612679.216548:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914408576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612679.220287:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8d85c8a-0380-4a63-8187-d0137cefd572:3305:1875495914408832:0@lo:400:kworker.0 00000100:00100000:0.0:1788612679.220358:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612679.220503:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914408960:0@lo:400:kworker.0 00000100:00100000:0.0:1788612679.220538:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612679.220578:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914408960 00000100:00100000:0.0:1788612679.220585:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914408960 00000100:00100000:0.0:1788612679.220628:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788612679.220636:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914408960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612679.220699:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875495914408960:12345-0@lo:400:kworker.0 Request processed in 62us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612679.220706:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788612679.220749:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875495914408960:0@lo:400:kworker.0 00000100:00100000:0.0:1788612679.220787:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612679.220807:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914409088:0@lo:400:kworker.0 00000100:00100000:0.0:1788612679.220832:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612679.220885:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914409088 00000100:00100000:0.0:1788612679.220889:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914409088 00000100:00100000:0.0:1788612679.220920:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612679.220927:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914409088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612679.220960:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914409088:12345-0@lo:400:kworker.0 Request processed in 34us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612679.220968:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788612679.220984:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612679.221002:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914409088:0@lo:400:kworker.0 00000100:00100000:0.0:1788612679.221036:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914409216:0@lo:400:kworker.0 00000100:00100000:3.0:1788612679.221500:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914408832 00000100:00100000:3.0:1788612679.221506:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914408832 00000100:00100000:3.0:1788612679.221534:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788612679.221542:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+19:3305:x1875495914408832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612679.221594:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+19:3305:x1875495914408832:12345-0@lo:400:kworker.0 Request processed in 54us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612679.221601:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788612679.222278:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8d85c8a-0380-4a63-8187-d0137cefd572:3305:1875495914408832:0@lo:400:kworker.0 00000100:00100000:0.0:1788612679.222475:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612679.223511:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914409216 00000100:00100000:1.0:1788612679.223520:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914409216 00000100:00100000:1.0:1788612679.223574:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612679.223583:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914409216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612679.223654:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875495914409216:12345-0@lo:400:kworker.0 Request processed in 72us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612679.223662:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788612679.223696:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612679.223730:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875495914409216:0@lo:400:kworker.0 00000001:00100000:3.0:1788612679.255275:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4888723e-f23f-4213-998f-bea11838d5b1 00000001:00100000:3.0:1788612679.255294:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a69c66e5-135a-4565-b61a-424712bcbd1e 00000001:00100000:0.0:1788612679.785914:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a69c66e5-135a-4565-b61a-424712bcbd1e 00000001:00100000:0.0:1788612679.785933:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4888723e-f23f-4213-998f-bea11838d5b1 00010000:00010000:2.0:1788612680.108339:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788612680.509180:0:16337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788612681.132582:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612682.157760:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788612682.332922:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4888723e-f23f-4213-998f-bea11838d5b1 00000100:00100000:2.0:1788612682.684034:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612682.684077:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612682.684100:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612682.684119:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612682.684134:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612682.684148:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612682.684186:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612682.684207:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893448960 00000100:00100000:2.0:1788612682.684216:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893448960 00000100:00100000:2.0:1788612682.684277:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:2.0:1788612682.684289:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+13:2354:x1875495893448960:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612682.684370:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+13:2354:x1875495893448960:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612682.684378:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 104 00000100:00100000:2.0:1788612682.684411:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893449216 00000100:00100000:2.0:1788612682.684415:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893449216 00000100:00100000:2.0:1788612682.684445:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893449344 00000100:00100000:2.0:1788612682.684447:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893449344 00000100:00100000:2.0:1788612682.684460:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893449600 00000100:00100000:2.0:1788612682.684463:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893449600 00000100:00100000:2.0:1788612682.684475:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893449728 00000100:00100000:2.0:1788612682.684476:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893449728 00000100:00100000:2.0:1788612682.684491:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:2.0:1788612682.684496:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2354:x1875495893449216:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612682.684540:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2354:x1875495893449216:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 42us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612682.684546:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:2.0:1788612682.684559:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:2.0:1788612682.684566:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2353:x1875495893449344:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612682.684587:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2353:x1875495893449344:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612682.684594:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:2.0:1788612682.684604:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:2.0:1788612682.684617:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4888723e-f23f-4213-998f-bea11838d5b1+5:2353:x1875495893449600:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612682.684654:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4888723e-f23f-4213-998f-bea11838d5b1+5:2353:x1875495893449600:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 38us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612682.684661:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:2.0:1788612682.684673:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:2.0:1788612682.684679:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4888723e-f23f-4213-998f-bea11838d5b1+5:2354:x1875495893449728:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612682.684700:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4888723e-f23f-4213-998f-bea11838d5b1+5:2354:x1875495893449728:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 22us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612682.684706:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:2.0:1788612682.684727:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893449088 00000100:00100000:2.0:1788612682.684731:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893449088 00000100:00100000:2.0:1788612682.684762:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893449472 00000100:00100000:2.0:1788612682.684764:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893449472 00000100:00100000:2.0:1788612682.684778:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:2.0:1788612682.684784:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+6:2353:x1875495893449088:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612682.684810:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+6:2353:x1875495893449088:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 26us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612682.684816:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:2.0:1788612682.684828:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:2.0:1788612682.684834:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d8792e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4888723e-f23f-4213-998f-bea11838d5b1+6:2354:x1875495893449472:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612682.684878:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d8792e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4888723e-f23f-4213-998f-bea11838d5b1+6:2354:x1875495893449472:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 45us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612682.684884:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00080000:2.0:1788612682.685042:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612682.685047:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612682.685055:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788612683.180928:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612684.214886:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612684.332482:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928d8792f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8d85c8a-0380-4a63-8187-d0137cefd572:3305:1875495914409344:0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.332552:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612684.332601:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec039ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914409856:0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.332641:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612684.332677:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788612684.332683:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eb7fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914409472:0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.332709:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612684.332726:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec039ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914409984:0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.332750:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612684.332774:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec039d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914409600:0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.332796:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612684.332814:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612684.332819:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec039e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914409728:0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.332856:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612684.332888:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914409344 00000100:00100000:2.0:1788612684.332895:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914409344 00000100:00100000:2.0:1788612684.332936:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788612684.332945:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+19:3305:x1875495914409344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.332992:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+19:3305:x1875495914409344:12345-0@lo:400:kworker.0 Request processed in 48us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612684.333000:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788612684.333031:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914409856 00000100:00100000:2.0:1788612684.333035:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914409856 00000100:00100000:2.0:1788612684.333061:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914409984 00000100:00100000:2.0:1788612684.333064:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914409984 00000100:00100000:2.0:1788612684.333085:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914409728 00000100:00100000:2.0:1788612684.333087:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914409728 00000100:00100000:2.0:1788612684.333098:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788612684.333103:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914409856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.333137:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875495914409856:12345-0@lo:400:kworker.0 Request processed in 34us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612684.333143:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788612684.333154:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788612684.333159:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914409984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.333183:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914409984:12345-0@lo:400:kworker.0 Request processed in 24us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612684.333188:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788612684.333197:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612684.333203:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914409728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.333231:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875495914409728:12345-0@lo:400:kworker.0 Request processed in 28us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612684.333236:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612684.333251:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914409472 00000100:00100000:2.0:1788612684.333255:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914409472 00000100:00100000:2.0:1788612684.333276:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914409600 00000100:00100000:2.0:1788612684.333279:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914409600 00000100:00100000:2.0:1788612684.333292:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612684.333297:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914409472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.333325:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914409472:12345-0@lo:400:kworker.0 Request processed in 27us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612684.333330:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612684.333340:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612684.333353:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914409600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.333382:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875495914409600:12345-0@lo:400:kworker.0 Request processed in 30us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612684.333388:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788612684.333416:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612684.333420:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612684.333422:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612684.333462:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec039e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875495914409728:0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.333473:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec039d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875495914409600:0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.333504:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eb7fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914409472:0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.333514:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec039ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914409984:0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.333522:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928d8792f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8d85c8a-0380-4a63-8187-d0137cefd572:3305:1875495914409344:0@lo:400:kworker.0 00000100:00100000:2.0:1788612684.333531:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec039ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875495914409856:0@lo:400:kworker.0 00000100:00100000:0.0:1788612684.333948:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612684.333959:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928e90cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914410112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612684.333991:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612684.334025:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914410112 00000100:00100000:0.0:1788612684.334029:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914410112 00000100:00100000:0.0:1788612684.334058:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612684.334064:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914410112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612684.334088:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612684.334125:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914410112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612684.334137:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612684.334172:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928e90cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914410112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612684.340642:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ea7bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914410240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612684.340723:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612684.340779:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914410240 00000100:00100000:0.0:1788612684.340787:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914410240 00000100:00100000:0.0:1788612684.340857:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788612684.340868:0:15063:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788612684.340869:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e90cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914410240:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612684.340876:0:15063:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1788612684.340903:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788612684.340950:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e90cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914410240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612684.340956:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612684.341002:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ea7bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914410240:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788612684.812198:0:16486:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffcf86ff0 20000000:00000080:1.0:1788612684.812216:0:16486:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff928d85c54400 uarg=0000000000000000 20000000:01000000:1.0:1788612684.812254:0:16486:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788612684.812260:0:16486:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788612684.812264:0:16486:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788612684.818170:0:16487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788612684.818424:0:16486:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788612684.836809:0:16486:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788612684.837252:0:16486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.837272:0:16486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928eacd12e00/0xfc956d548af42848 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af42841 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.837280:0:16486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928d8789e800/0xfc956d548af42895 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af4288e expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.837287:0:16486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928eacd13000/0xfc956d548af429d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af429c9 expref: 18 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.837297:0:16486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ec21e9800/0xfc956d548af42aef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc9a expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.837320:0:16486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff928ea7bdee00/0xfc956d548af42b27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddcfc expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.837327:0:16486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.837373:0:16486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ea7bdee00/0xfc956d548af42b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddcfc expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.837386:0:16486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928ea7bdee00/0xfc956d548af42b27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddcfc expref: 12 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612684.837401:0:16486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1875495914410368:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612684.837515:0:16486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928ec21e9800/0xfc956d548af42aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc9a expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.837524:0:16486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928ec21e9800/0xfc956d548af42aef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc9a expref: 12 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612684.837533:0:16486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1875495914410496:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612684.837565:0:16486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928eacd13000/0xfc956d548af429d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af429c9 expref: 18 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.837573:0:16486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928eacd13000/0xfc956d548af429d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af429c9 expref: 18 pid: 14372 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612684.837580:0:16486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd58e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1875495914410624:0@lo:104: 00000100:00100000:0.0:1788612684.837631:0:16486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612684.837671:0:16486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928d8789e800/0xfc956d548af42895 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af4288e expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.837677:0:16486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928d8789e800/0xfc956d548af42895 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af4288e expref: 18 pid: 14370 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612684.837685:0:16486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eacd5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1875495914410752:0@lo:104: 00000100:00100000:0.0:1788612684.837704:0:16486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612684.837726:0:16486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff928eacd12e00/0xfc956d548af42848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfc956d548af42841 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.837732:0:16486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff928eacd12e00/0xfc956d548af42848 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfc956d548af42841 expref: 18 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612684.837739:0:16486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadeaa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1875495914410880:0@lo:104: 00000100:00100000:0.0:1788612684.837759:0:16486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612684.837768:0:16486:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90b63300 going to sleep for 11 seconds 00000100:00100000:2.0:1788612684.838002:0:14361:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788612684.838015:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914410624 00000100:00100000:2.0:1788612684.838021:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914410624 00000100:00100000:2.0:1788612684.838056:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914410752 00000100:00100000:2.0:1788612684.838059:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914410752 00000100:00100000:2.0:1788612684.838067:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914410880 00000100:00100000:2.0:1788612684.838069:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914410880 00000100:00100000:2.0:1788612684.838083:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788612684.838091:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8d85c8a-0380-4a63-8187-d0137cefd572+5:16486:x1875495914410624:12345-0@lo:104: 00010000:00010000:2.0:1788612684.838103:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af429d0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838169:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612684.838182:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8d85c8a-0380-4a63-8187-d0137cefd572+5:16486:x1875495914410624:12345-0@lo:104: Request processed in 92us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612684.838189:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788612684.838219:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788612684.838226:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eacd58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8d85c8a-0380-4a63-8187-d0137cefd572+4:16486:x1875495914410752:12345-0@lo:104: 00010000:00010000:2.0:1788612684.838234:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af42895 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838269:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788612684.838278:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eacd58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8d85c8a-0380-4a63-8187-d0137cefd572+4:16486:x1875495914410752:12345-0@lo:104: Request processed in 51us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612684.838284:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788612684.838296:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788612684.838302:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7b89850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8d85c8a-0380-4a63-8187-d0137cefd572+3:16486:x1875495914410880:12345-0@lo:104: 00010000:00010000:2.0:1788612684.838309:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af42848 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838335:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788612684.838340:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7b89850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8d85c8a-0380-4a63-8187-d0137cefd572+3:16486:x1875495914410880:12345-0@lo:104: Request processed in 39us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612684.838345:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788612684.838377:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788612684.838383:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af429d0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838390:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdec00 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612684.838394:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af429d0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838413:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af429d0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612684.838420:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af429d0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612684.838426:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788612684.838456:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af429d0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838463:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612684.838483:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af429d0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838491:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928ea7bdec00/0xfc956d548af429c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af429d0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838503:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788612684.838506:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af42895 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838512:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b61000 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612684.838515:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af42895 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838521:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af42895 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612684.838527:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af42895 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612684.838538:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788612684.838553:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af42895 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838558:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612684.838564:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af42895 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838570:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e90b61000/0xfc956d548af4288e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af42895 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838578:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612684.838581:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfc956d548af42848 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838586:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e90b60800 already unused, calling callback (ffffffffc1a10c20) 10000000:00010000:2.0:1788612684.838588:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfc956d548af42848 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838593:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfc956d548af42848 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612684.838613:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfc956d548af42848 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612684.838619:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788612684.838632:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af42848 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838637:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612684.838658:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af42848 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838665:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff928e90b60800/0xfc956d548af42841 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfc956d548af42848 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.838678:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612684.838680:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612684.838682:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612684.838688:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612684.838708:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec039ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8d85c8a-0380-4a63-8187-d0137cefd572:3305:1875495914411008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612684.838739:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612684.838781:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612684.838787:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec039ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8d85c8a-0380-4a63-8187-d0137cefd572:3305:1875495914411136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612684.838808:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612684.838875:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec039d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8d85c8a-0380-4a63-8187-d0137cefd572:3307:1875495914411264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612684.838905:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612684.838937:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914411008 00000100:00100000:2.0:1788612684.838942:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914411008 00010000:00010000:2.0:1788612684.838961:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928eacd13000/0xfc956d548af429d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af429c9 expref: 19 pid: 14372 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612684.838976:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914411136 00000100:00100000:2.0:1788612684.838978:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914411136 00010000:00010000:2.0:1788612684.838989:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928d8789e800/0xfc956d548af42895 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af4288e expref: 20 pid: 14370 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612684.838999:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914411264 00000100:00100000:2.0:1788612684.839002:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914411264 00010000:00010000:2.0:1788612684.839011:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928eacd12e00/0xfc956d548af42848 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af42841 expref: 21 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612684.839032:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788612684.839038:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8d85c8a-0380-4a63-8187-d0137cefd572+21:3305:x1875495914411008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612684.839050:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612684.839055:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928eacd13000/0xfc956d548af429d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af429c9 expref: 21 pid: 14372 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.839064:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928eacd13000/0xfc956d548af429d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af429c9 expref: 21 pid: 14372 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.839081:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612684.839114:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8d85c8a-0380-4a63-8187-d0137cefd572+21:3305:x1875495914411008:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612684.839121:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788612684.839133:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788612684.839139:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8d85c8a-0380-4a63-8187-d0137cefd572+20:3305:x1875495914411136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612684.839146:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612684.839150:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928d8789e800/0xfc956d548af42895 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af4288e expref: 20 pid: 14370 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.839158:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928d8789e800/0xfc956d548af42895 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af4288e expref: 20 pid: 14370 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.839167:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612684.839189:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8d85c8a-0380-4a63-8187-d0137cefd572+20:3305:x1875495914411136:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612684.839194:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788612684.839207:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788612684.839218:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eaf393450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8d85c8a-0380-4a63-8187-d0137cefd572+19:3307:x1875495914411264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612684.839225:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612684.839229:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928eacd12e00/0xfc956d548af42848 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfc956d548af42841 expref: 19 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.839237:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928eacd12e00/0xfc956d548af42848 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfc956d548af42841 expref: 19 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.839247:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612684.839274:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eaf393450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8d85c8a-0380-4a63-8187-d0137cefd572+19:3307:x1875495914411264:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612684.839280:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788612684.839344:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec039d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8d85c8a-0380-4a63-8187-d0137cefd572:3307:1875495914411264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612684.839370:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec039ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8d85c8a-0380-4a63-8187-d0137cefd572:3305:1875495914411136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612684.839377:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec039ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8d85c8a-0380-4a63-8187-d0137cefd572:3305:1875495914411008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612684.841418:0:16486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928eacd13000/0xfc956d548af429d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af429c9 expref: 18 pid: 14372 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612684.841440:0:16486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1875495914410624:0@lo:104: 00010000:00010000:0.0:1788612684.841455:0:16486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928d8789e800/0xfc956d548af42895 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af4288e expref: 17 pid: 14370 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612684.841463:0:16486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1875495914410752:0@lo:104: 00010000:00010000:0.0:1788612684.841475:0:16486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928eacd12e00/0xfc956d548af42848 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfc956d548af42841 expref: 16 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612684.841483:0:16486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadeaa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1875495914410880:0@lo:104: 00000100:00100000:2.0:1788612684.859450:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612684.859491:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612684.859527:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893449856 00000100:00100000:2.0:1788612684.859537:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893449856 00010000:00010000:2.0:1788612684.859572:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ec21e9800/0xfc956d548af42aef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc9a expref: 13 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612684.859612:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893449984 00000100:00100000:2.0:1788612684.859616:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893449984 00010000:00010000:2.0:1788612684.859629:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff928ea7bdee00/0xfc956d548af42b27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddcfc expref: 14 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612684.859646:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:2.0:1788612684.859670:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de248df6-b80e-4f4c-babe-3ba2189953f0+14:2353:x1875495893449856:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612684.859687:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612684.859693:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ec21e9800/0xfc956d548af42aef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc9a expref: 14 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.859705:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ec21e9800/0xfc956d548af42aef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc9a expref: 14 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.859724:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612684.859785:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de248df6-b80e-4f4c-babe-3ba2189953f0+14:2353:x1875495893449856:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 116us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612684.859792:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:2.0:1788612684.859810:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:2.0:1788612684.859817:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de248df6-b80e-4f4c-babe-3ba2189953f0+13:2355:x1875495893449984:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612684.859825:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612684.859829:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff928ea7bdee00/0xfc956d548af42b27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddcfc expref: 13 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.859874:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff928ea7bdee00/0xfc956d548af42b27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddcfc expref: 13 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.859888:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.859896:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.859911:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.859929:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.859936:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.859942:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.859948:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612684.859952:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.859960:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.859969:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612684.859980:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612684.859999:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de248df6-b80e-4f4c-babe-3ba2189953f0+13:2355:x1875495893449984:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 182us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612684.860005:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00010000:00010000:0.0:1788612684.860110:0:16486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea7bdee00/0xfc956d548af42b27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddcfc expref: 12 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612684.860133:0:16486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1875495914410368:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612684.860148:0:16486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ec21e9800/0xfc956d548af42aef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddc9a expref: 11 pid: 14371 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612684.860156:0:16486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eacd5a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16486:1875495914410496:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612684.860188:0:16486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.860198:0:16486:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.860204:0:16486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612684.860210:0:16486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff928ea7bde400/0xfc956d548af42b51 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612685.228401:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788612685.677133:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788612685.884754:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612685.884795:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893450112 00000100:00100000:1.0:1788612685.884805:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893450112 00000100:00100000:1.0:1788612685.884879:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 106 00000100:00100000:1.0:1788612685.884890:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+11:13755:x1875495893450112:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612685.884907:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612685.884928:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea0144a00/0xfc956d548af42b58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd2d expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612685.884971:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea0144a00/0xfc956d548af42b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd2d expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612685.884984:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea0144a00/0xfc956d548af42b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd2d expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612685.884995:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0144a00, rc 0) 00000100:00100000:1.0:1788612685.885048:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+12:13755:x1875495893450112:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 160us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612685.885055:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 106 00000100:00100000:2.0:1788612685.890415:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612685.890456:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893450240 00000100:00100000:2.0:1788612685.890465:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893450240 00000100:00100000:2.0:1788612685.890512:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 107 00000100:00100000:2.0:1788612685.890521:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+12:13755:x1875495893450240:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612685.890830:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+12:13755:x1875495893450240:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 309us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612685.890861:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 107 00000100:00100000:0.0:1788612685.896091:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612685.905987:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893450368 00000100:00100000:2.0:1788612685.906005:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893450368 00000100:00100000:2.0:1788612685.906073:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 108 00000100:00100000:2.0:1788612685.906084:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+12:13755:x1875495893450368:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612685.906313:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+12:13755:x1875495893450368:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 230us (10234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612685.906321:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 108 00000100:00100000:2.0:1788612685.912959:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612685.913066:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893450496 00000100:00100000:3.0:1788612685.913076:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893450496 00000100:00100000:3.0:1788612685.913121:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 109 00000100:00100000:3.0:1788612685.913131:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+12:13755:x1875495893450496:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612685.913148:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612685.913166:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928d8789fa00/0xfc956d548af42b5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd34 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612685.913194:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928d8789fa00/0xfc956d548af42b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd34 expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612685.913213:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928d8789fa00/0xfc956d548af42b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd34 expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612685.913222:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928d8789fa00, rc 0) 00000100:00100000:3.0:1788612685.913278:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+13:13755:x1875495893450496:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 148us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612685.913285:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 109 00000100:00100000:2.0:1788612685.916541:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612685.916633:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893450624 00000100:00100000:3.0:1788612685.916645:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893450624 00000100:00100000:3.0:1788612685.916701:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 110 00000100:00100000:3.0:1788612685.916718:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+13:13755:x1875495893450624:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612685.919945:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de248df6-b80e-4f4c-babe-3ba2189953f0+13:13755:x1875495893450624:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 3217us (3403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612685.919960:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 110 00000100:00100000:3.0:1788612685.931109:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612685.931295:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893450752 00000100:00100000:2.0:1788612685.931306:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893450752 00000100:00100000:2.0:1788612685.931370:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 111 00000100:00100000:2.0:1788612685.931382:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+13:13755:x1875495893450752:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612685.931622:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+13:13755:x1875495893450752:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 241us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612685.931631:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 111 10000000:01000000:2.0:1788612686.252719:0:14374:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788612686.252728:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928d86ab4800 from 10 10000000:01000000:2.0:1788612686.252734:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612686.252803:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e8600/0xfc956d548af42b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612686.252817:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ec21e8600/0xfc956d548af42b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612686.252860:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ec21e8600/0xfc956d548af42b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612686.252888:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec039d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914411392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612686.252978:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612686.253034:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec0357cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612686.253233:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914411392 00000100:00100000:0.0:1788612686.253241:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914411392 00000100:00100000:0.0:1788612686.253297:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788612686.253306:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+16:14374:x1875495914411392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612686.253320:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612686.253334:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea7bdf000/0xfc956d548af42b6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af42b66 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612686.253359:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea7bdf000/0xfc956d548af42b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af42b66 expref: 17 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612686.253491:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea7bdf000/0xfc956d548af42b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af42b66 expref: 17 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612686.253501:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf000, rc 0) 00000100:00100000:0.0:1788612686.253544:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+17:14374:x1875495914411392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 239us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612686.253551:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788612686.254272:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec039d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914411392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612686.254292:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ec21e8600/0xfc956d548af42b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42b6d expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612686.254300:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ec21e8600/0xfc956d548af42b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af42b6d expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612686.254370:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec039d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914411520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612686.254483:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612686.254558:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec0357cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1788612686.256864:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612686.259295:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914411520 00000100:00100000:0.0:1788612686.259313:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914411520 00000100:00100000:0.0:1788612686.259766:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788612686.259781:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9a8c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+17:14374:x1875495914411520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612686.261297:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9a8c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+17:14374:x1875495914411520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1512us (6804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612686.261310:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788612686.262833:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec039d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914411520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612686.262947:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec039d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914411648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612686.263022:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612686.263061:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec0357cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612686.263232:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914411648 00000100:00100000:0.0:1788612686.263239:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914411648 00000100:00100000:0.0:1788612686.263290:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788612686.263308:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e9a8ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+17:14374:x1875495914411648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612686.264559:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e9a8ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+17:14374:x1875495914411648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1246us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612686.264571:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788612686.264896:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec039d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914411648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788612686.275301:0:16550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788612686.275548:0:14374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788612686.275569:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612686.275594:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e8600/0xfc956d548af42b66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42b6d expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612686.275639:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ec21e8600/0xfc956d548af42b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42b6d expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612686.275650:0:14374:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788612686.275653:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928ec00ff000 from 10 10000000:01000000:2.0:1788612686.275656:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612686.275697:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af42b74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612686.275705:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af42b74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612686.275716:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af42b74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612686.275744:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec039e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914411776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612686.275818:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612686.275887:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928ec0357c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612686.275961:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914411776 00000100:00100000:1.0:1788612686.275969:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914411776 00000100:00100000:1.0:1788612686.276022:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788612686.276031:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+17:14374:x1875495914411776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612686.276044:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612686.276056:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928ea0144800/0xfc956d548af42b7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af42b74 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612686.276077:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928ea0144800/0xfc956d548af42b7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af42b74 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612686.276087:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928ea0144800/0xfc956d548af42b7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af42b74 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612686.276095:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0144800, rc 0) 00000100:00100000:1.0:1788612686.276133:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+18:14374:x1875495914411776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612686.276149:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788612686.276321:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec039e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914411776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612686.276336:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af42b74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42b7b expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612686.276345:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af42b74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af42b7b expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612686.276413:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914411904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612686.276439:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612686.276455:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91082900 going to sleep for 11 seconds 00000100:00100000:1.0:1788612686.276468:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914411904 00000100:00100000:1.0:1788612686.276471:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914411904 00000100:00100000:1.0:1788612686.276490:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788612686.276496:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+18:14374:x1875495914411904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612686.277013:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+18:14374:x1875495914411904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 515us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612686.277022:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788612686.277056:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914411904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612686.277086:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914412032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612686.277124:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612686.277139:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91082900 going to sleep for 11 seconds 00000100:00100000:1.0:1788612686.277150:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914412032 00000100:00100000:1.0:1788612686.277154:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914412032 00000100:00100000:1.0:1788612686.277169:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788612686.277253:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+18:14374:x1875495914412032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612686.277466:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+18:14374:x1875495914412032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 284us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612686.277474:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788612686.277511:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914412032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788612686.288760:0:16552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788612686.289479:0:14374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788612686.289506:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788612686.289518:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af42b74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42b7b expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612686.289531:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ec21e9e00/0xfc956d548af42b74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42b7b expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612686.289543:0:14374:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788612686.289546:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff928e923eb800 from 10 10000000:01000000:1.0:1788612686.289549:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788612686.289609:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0145200/0xfc956d548af42b82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612686.289619:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff928ea0145200/0xfc956d548af42b82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612686.289631:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff928ea0145200/0xfc956d548af42b82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612686.289659:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914412160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788612686.289730:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612686.289782:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91082900 going to sleep for 11 seconds 00000100:00100000:3.0:1788612686.290714:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914412160 00000100:00100000:3.0:1788612686.290725:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914412160 00000100:00100000:3.0:1788612686.290779:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788612686.290790:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+18:14374:x1875495914412160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612686.290805:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612686.290820:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff928d8789ea00/0xfc956d548af42b89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc956d548af42b82 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612686.290864:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff928d8789ea00/0xfc956d548af42b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfc956d548af42b82 expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612686.290876:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff928d8789ea00/0xfc956d548af42b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfc956d548af42b82 expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612686.290885:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928d8789ea00, rc 0) 00000100:00100000:3.0:1788612686.291404:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+19:14374:x1875495914412160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 614us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612686.291412:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788612686.293091:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914412160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612686.293116:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff928ea0145200/0xfc956d548af42b82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42b89 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612686.293129:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff928ea0145200/0xfc956d548af42b82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfc956d548af42b89 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612686.293216:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914412288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612686.293267:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612686.293307:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91082900 going to sleep for 11 seconds 00000100:00100000:3.0:1788612686.293459:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914412288 00000100:00100000:3.0:1788612686.293465:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914412288 00000100:00100000:3.0:1788612686.293510:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788612686.293526:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+19:14374:x1875495914412288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612686.293798:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8d85c8a-0380-4a63-8187-d0137cefd572+19:14374:x1875495914412288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612686.293805:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788612686.294947:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914412288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612686.295005:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadeaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914412416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612686.295072:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612686.295105:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e90b63180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612686.295124:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914412416 00000100:00100000:0.0:1788612686.295129:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914412416 00000100:00100000:0.0:1788612686.295163:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788612686.295170:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+19:14374:x1875495914412416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612686.295541:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8d85c8a-0380-4a63-8187-d0137cefd572+19:14374:x1875495914412416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 370us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612686.295549:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788612686.295611:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadeaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8d85c8a-0380-4a63-8187-d0137cefd572:14374:1875495914412416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788612686.299809:0:16554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788612686.306075:0:14374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788612686.306112:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788612686.306124:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff928ea0145200/0xfc956d548af42b82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42b89 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612686.306137:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff928ea0145200/0xfc956d548af42b82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfc956d548af42b89 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612687.276032:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612687.803456:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612687.803539:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612687.803580:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612687.803621:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612687.803638:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612687.803678:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612687.803700:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612687.803737:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893451264 00000100:00100000:3.0:1788612687.803750:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893451264 00000100:00100000:3.0:1788612687.803810:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893451520 00000100:00100000:3.0:1788612687.803813:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893451520 00000100:00100000:3.0:1788612687.803823:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893451136 00000100:00100000:3.0:1788612687.803825:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893451136 00000100:00100000:3.0:1788612687.803877:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893451648 00000100:00100000:3.0:1788612687.803880:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893451648 00000100:00100000:3.0:1788612687.803897:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:3.0:1788612687.803909:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2353:x1875495893451264:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612687.803950:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788612687.803983:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788612687.804006:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2353:x1875495893451264:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 97us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612687.804019:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:0.0:1788612687.804023:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893450880 00000100:00100000:0.0:1788612687.804036:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893450880 00000100:00100000:3.0:1788612687.804045:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:3.0:1788612687.804055:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4888723e-f23f-4213-998f-bea11838d5b1+5:2353:x1875495893451520:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612687.804085:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4888723e-f23f-4213-998f-bea11838d5b1+5:2353:x1875495893451520:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 32us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612687.804109:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00100000:3.0:1788612687.804126:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:0.0:1788612687.804136:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+13:2353:x1875495893450880:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612687.804146:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:3.0:1788612687.804156:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2353:x1875495893451136:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612687.804263:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788612687.804277:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:1.0:1788612687.804288:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4888723e-f23f-4213-998f-bea11838d5b1+5:2353:x1875495893451648:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612687.804370:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893451008 00000100:00100000:2.0:1788612687.804375:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893451008 00000100:00100000:2.0:1788612687.804414:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893451392 00000100:00100000:2.0:1788612687.804417:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893451392 00000100:00100000:2.0:1788612687.804435:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:2.0:1788612687.804441:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+6:2353:x1875495893451008:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1788612687.804551:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2353:x1875495893451136:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 396us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612687.804558:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:0.0:1788612687.808027:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de248df6-b80e-4f4c-babe-3ba2189953f0+13:2353:x1875495893450880:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 3887us (4393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612687.808043:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 121 00000100:00080000:0.0:1788612687.808321:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612687.808328:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788612687.808330:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612687.808341:0:14379:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788612687.808349:0:14379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788612687.808402:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:0.0:1788612687.808414:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4888723e-f23f-4213-998f-bea11838d5b1+6:2353:x1875495893451392:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612687.808469:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4888723e-f23f-4213-998f-bea11838d5b1+6:2353:x1875495893451392:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 58us (4790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612687.808475:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:1.0:1788612687.817079:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4888723e-f23f-4213-998f-bea11838d5b1+5:2353:x1875495893451648:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 12776us (13359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612687.817101:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:2.0:1788612687.824115:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+6:2353:x1875495893451008:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 19652us (20654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612687.824136:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00010000:00010000:2.0:1788612688.301387:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612688.528202:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612688.528631:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893451776 00000100:00100000:0.0:1788612688.528657:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893451776 00000100:00100000:0.0:1788612688.528743:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:0.0:1788612688.528755:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+6:14415:x1875495893451776:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612688.528775:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612688.528799:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42b90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd3b expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529066:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42b97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529081:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42b97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529095:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42b97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529109:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42b9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529115:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42b9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529121:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42b9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529620:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af42ba5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529640:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af42ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529710:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af42ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612688.529739:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788612688.529743:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612688.529779:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af42ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529789:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42b97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529796:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42b97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529802:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42b97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529808:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612688.529812:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42b97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529820:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42b97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529832:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e838ce300) 00010000:00010000:0.0:1788612688.529928:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612688.529936:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42b97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529953:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42b97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529967:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42b9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529973:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42b9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529979:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42b9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529985:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612688.529988:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42b9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.529994:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42b9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.530002:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff928e91fbbc00) 00010000:00010000:0.0:1788612688.530005:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612688.530008:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42b9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.530014:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42b9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.530047:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42b90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd3b expref: 8 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.530071:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdfc00/0xfc956d548af42ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd3b expref: 7 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.530079:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff928e91fbb600) 00010000:00010000:0.0:1788612688.530081:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612688.530084:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdfc00, rc 0) 00000100:00100000:0.0:1788612688.530152:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+7:14415:x1875495893451776:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1399us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612688.530160:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:3.0:1788612688.546893:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612688.548710:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893452032 00000100:00100000:0.0:1788612688.548728:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893452032 00000100:00100000:0.0:1788612688.548811:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:0.0:1788612688.548825:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+7:14415:x1875495893452032:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612688.548877:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612688.548900:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42bac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd42 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549004:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bb3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549019:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549031:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549045:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549067:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549074:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549434:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af42bc1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549445:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af42bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549464:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af42bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612688.549475:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788612688.549692:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549700:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bb3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549707:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549713:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612688.549718:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549725:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bb3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549748:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff928e91fbb600) 00010000:00010000:0.0:1788612688.549750:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612688.549755:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bb3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549761:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bb3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549773:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549778:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bba lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549784:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549788:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612688.549790:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549796:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bba lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549801:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff928e91fbbc00) 00010000:00010000:0.0:1788612688.549803:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612688.549806:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bba lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.549810:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.550365:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42bac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd42 expref: 10 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.550381:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdee00/0xfc956d548af42bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd42 expref: 9 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.550389:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb300) 00010000:00010000:0.0:1788612688.550391:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612688.550394:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdee00, rc 0) 00000100:00100000:0.0:1788612688.550467:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+9:14415:x1875495893452032:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 1644us (3649us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788612688.550475:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:3.0:1788612688.560048:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612688.560153:0:16599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893452160 00000100:00100000:2.0:1788612688.560173:0:16599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893452160 00000100:00100000:2.0:1788612688.560255:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:2.0:1788612688.560267:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+9:14415:x1875495893452160:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788612688.560391:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+9:14415:x1875495893452160:12345-192.168.202.6@tcp:59:lhsmtool_posix.0 Request processed in 126us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612688.560399:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:3.0:1788612688.600101:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612688.600228:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893452288 00000100:00100000:0.0:1788612688.600247:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893452288 00000100:00100000:0.0:1788612688.600339:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:0.0:1788612688.600357:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+9:14421:x1875495893452288:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1788612688.600386:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612688.600415:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42bcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd49 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.600497:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.600514:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.600529:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.600575:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.600584:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.600590:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.600913:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.600922:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.600931:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.600938:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612688.600943:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.600952:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.600966:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e838ce300) 00010000:00010000:0.0:1788612688.600969:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612688.600975:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.600981:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42bd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.601003:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.601010:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bdd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.601015:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.601020:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612688.601023:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.601029:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bdd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.601036:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff928e91fbbc00) 00010000:00010000:0.0:1788612688.601038:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612688.601041:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bdd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.601046:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42bdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.601083:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42bcf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd49 expref: 10 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.601094:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e838ce300) 00010000:00010000:0.0:1788612688.601096:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612688.601107:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42bcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd49 expref: 10 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.601117:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf400, rc 0) 00000100:00100000:2.0:1788612688.601280:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+9:14421:x1875495893452288:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 919us (1179us total) trans 0 rc 301/301 00000100:00100000:2.0:1788612688.601293:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 18 00000100:00100000:3.0:1788612688.605326:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612688.607949:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893452416 00000100:00100000:0.0:1788612688.607970:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893452416 00000100:00100000:0.0:1788612688.608057:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:0.0:1788612688.608069:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a69c66e5-135a-4565-b61a-424712bcbd1e+9:14421:x1875495893452416:12345-192.168.202.6@tcp:700:lfs.0 00000100:00100000:0.0:1788612688.608194:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a69c66e5-135a-4565-b61a-424712bcbd1e+9:14421:x1875495893452416:12345-192.168.202.6@tcp:700:lfs.0 Request processed in 126us (2878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612688.608207:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1788612688.610060:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612688.610175:0:16599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893452672 00000100:00100000:2.0:1788612688.610186:0:16599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893452672 00000100:00100000:2.0:1788612688.610251:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 19 00000100:00100000:2.0:1788612688.610262:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+9:14421:x1875495893452672:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:2.0:1788612688.610318:0:16599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612688.610357:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61e00/0xfc956d548af42b12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddcc4 expref: 9 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.610381:0:16599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e838ce300) 00010000:00010000:2.0:1788612688.610386:0:16599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612688.610586:0:16599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.610601:0:16599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42b4a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd26 expref: 5 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.610609:0:16599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.612004:0:16599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42b4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd26 expref: 5 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.612033:0:16599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42b4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd26 expref: 5 pid: 14379 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612688.612051:0:16599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec039df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16599:1875495914412544:192.168.202.6@tcp:104: 00000100:00100000:2.0:1788612688.612156:0:16599:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e87d0d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788612688.616100:0:16599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec039df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16599:1875495914412544:192.168.202.6@tcp:104: 00010000:00010000:2.0:1788612688.616135:0:16599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612688.617289:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612688.618332:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893452800 00000100:00100000:2.0:1788612688.618344:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893452800 00010000:00010000:2.0:1788612688.618389:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42b4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd26 expref: 6 pid: 14379 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612688.618440:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:2.0:1788612688.618450:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4888723e-f23f-4213-998f-bea11838d5b1+6:2356:x1875495893452800:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612688.618465:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612688.618472:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42b4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd26 expref: 6 pid: 14379 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.618484:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42b4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd26 expref: 6 pid: 14379 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.618523:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e90b61800/0xfc956d548af42b4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd26 expref: 6 pid: 14379 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.618542:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e838ce300) 00010000:00010000:2.0:1788612688.618548:0:14362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.618567:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.618575:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.618610:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612688.618720:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4888723e-f23f-4213-998f-bea11838d5b1+5:2356:x1875495893452800:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 271us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612688.618728:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00010000:00010000:0.0:1788612688.618737:0:16599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.618746:0:16599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.618768:0:16599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42beb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.618778:0:16599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42beb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.618786:0:16599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42beb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612688.620535:0:16599:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788612688.620562:0:16599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.620584:0:16599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.620591:0:16599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.620596:0:16599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612688.620601:0:16599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.620609:0:16599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.620623:0:16599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e838ce300) 00010000:00010000:1.0:1788612688.620627:0:16599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612688.620632:0:16599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.620638:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8000/0xfc956d548af42be4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612688.620660:0:16599:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006863855d reply state 00000000d0245db1 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42beb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612688.620671:0:16599:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612688.620744:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+10:14421:x1875495893452672:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 10482us (10693us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788612688.620753:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 19 00010000:00010000:1.0:1788612688.625571:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42beb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.625608:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42beb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.625616:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42beb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.625622:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612688.625627:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42beb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.625636:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42beb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.625652:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff928e91fbbc00) 00010000:00010000:1.0:1788612688.625656:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612688.625661:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42beb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.625667:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42beb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612688.709438:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612688.710096:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893452928 00000100:00100000:2.0:1788612688.710109:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893452928 00000100:00100000:2.0:1788612688.710193:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:2.0:1788612688.710204:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+9:14429:x1875495893452928:12345-192.168.202.6@tcp:101:lctl.0 00010000:00010000:2.0:1788612688.710228:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612688.710253:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9200/0xfc956d548af42bf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd50 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.710319:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af42bf9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.710350:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af42bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.710361:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af42bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612688.710395:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788612688.710398:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612688.710436:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af42bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.710459:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9200/0xfc956d548af42bf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd50 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.710477:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8400/0xfc956d548af42bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd50 expref: 10 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.710486:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d500) 00010000:00010000:2.0:1788612688.710489:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612688.710493:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8400, rc 0) 00000100:00100000:2.0:1788612688.710561:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+10:14429:x1875495893452928:12345-192.168.202.6@tcp:101:lctl.0 Request processed in 350us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612688.710568:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 20 00000100:00100000:2.0:1788612688.740641:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612688.740735:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893453056 00000100:00100000:0.0:1788612688.740747:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893453056 00000100:00100000:0.0:1788612688.740811:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:0.0:1788612688.740821:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4888723e-f23f-4213-998f-bea11838d5b1+5:14430:x1875495893453056:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1788612688.740890:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612688.740922:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd57 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.740998:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42c07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.741011:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42c07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.741023:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42c07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612688.741057:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788612688.741060:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612688.741081:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42c07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.741104:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd57 expref: 7 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.741124:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf600/0xfc956d548af42c07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd57 expref: 6 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.741132:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d500) 00010000:00010000:0.0:1788612688.741135:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612688.741139:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf600, rc 0) 00000100:00100000:0.0:1788612688.741415:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4888723e-f23f-4213-998f-bea11838d5b1+6:14430:x1875495893453056:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 595us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612688.741423:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 21 00000100:00100000:3.0:1788612688.747514:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612688.747612:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893453184 00000100:00100000:2.0:1788612688.747622:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893453184 00000100:00100000:2.0:1788612688.747681:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:2.0:1788612688.747691:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4888723e-f23f-4213-998f-bea11838d5b1+6:14430:x1875495893453184:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612688.747723:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612688.747745:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9200/0xfc956d548af42c0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd5e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.747804:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42c15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.747818:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42c15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788612688.749101:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788612688.749520:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42c15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749561:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749574:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749583:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749680:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af42c23 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749688:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af42c23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749695:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af42c23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612688.749727:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788612688.749743:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612688.749767:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af42c23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749778:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42c15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749784:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42c15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749791:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42c15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749796:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e8c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612688.749801:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42c15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749808:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42c15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749821:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d500) 00010000:00010000:2.0:1788612688.749824:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612688.749829:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42c15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749972:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8c00/0xfc956d548af42c15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749986:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.749991:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.750006:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.750011:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:2.0:1788612688.750014:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.750021:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.750029:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff928e9231d600) 00010000:00010000:2.0:1788612688.750031:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612688.750034:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.750040:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.750080:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9200/0xfc956d548af42c0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd5e expref: 8 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.750094:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af42c23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd5e expref: 7 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.750101:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff928e9231da00) 00010000:00010000:2.0:1788612688.750103:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612688.750105:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e8e00, rc 0) 00000100:00100000:2.0:1788612688.750249:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4888723e-f23f-4213-998f-bea11838d5b1+7:14430:x1875495893453184:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 2556us (2742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612688.750267:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 22 00000100:00100000:3.0:1788612688.755468:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612688.755662:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893453440 00000100:00100000:0.0:1788612688.755674:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893453440 00000100:00100000:0.0:1788612688.755728:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:0.0:1788612688.755739:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4888723e-f23f-4213-998f-bea11838d5b1+7:14430:x1875495893453440:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1788612688.755759:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612688.755781:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd65 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612688.755919:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788612688.756049:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd65 expref: 9 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.756064:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d500) 00010000:00010000:0.0:1788612688.756067:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612688.756072:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd65 expref: 9 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.756085:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf200, rc 0) 00000100:00100000:0.0:1788612688.756140:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4888723e-f23f-4213-998f-bea11838d5b1+8:14430:x1875495893453440:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 404us (685us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788612688.756147:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 23 00000100:00100000:3.0:1788612688.760707:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612688.761642:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893453696 00000100:00100000:0.0:1788612688.761655:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893453696 00000100:00100000:0.0:1788612688.761726:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:0.0:1788612688.761737:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ea7bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4888723e-f23f-4213-998f-bea11838d5b1+8:14430:x1875495893453696:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:0.0:1788612688.761797:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612688.761827:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e8e00/0xfc956d548af42c23 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd5e expref: 8 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.761880:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff928e9231da00) 00010000:00010000:0.0:1788612688.761895:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612688.761919:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c38 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.761933:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.761944:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788612688.762162:0:14377:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6deed71 reply state 00000000fcfbd236 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612688.762171:0:14377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788612688.762180:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788612688.762274:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ea7bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4888723e-f23f-4213-998f-bea11838d5b1+9:14430:x1875495893453696:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 538us (1576us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788612688.762282:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 24 00000100:00100000:3.0:1788612688.772171:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612688.772907:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893453952 00000100:00100000:2.0:1788612688.772919:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893453952 00000100:00100000:2.0:1788612688.773050:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:2.0:1788612688.773062:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4888723e-f23f-4213-998f-bea11838d5b1+9:14430:x1875495893453952:12345-192.168.202.6@tcp:35:lfs.0 00010000:00010000:1.0:1788612688.773227:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.773245:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c38 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.773253:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.773259:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612688.773278:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.773287:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c38 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.773302:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff928e91fbb100) 00010000:00010000:1.0:1788612688.773304:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788612688.773309:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c38 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.773315:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c38 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612688.777770:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4888723e-f23f-4213-998f-bea11838d5b1+9:14430:x1875495893453952:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 4697us (5595us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788612688.777785:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:3.0:1788612688.784059:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612688.784683:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893454208 00000100:00100000:0.0:1788612688.784694:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893454208 00000100:00100000:0.0:1788612688.784752:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:0.0:1788612688.784762:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4888723e-f23f-4213-998f-bea11838d5b1+9:14430:x1875495893454208:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1788612688.784786:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612688.784804:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af42c3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd6c expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.784924:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.784951:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.784973:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.784994:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42c4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785000:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42c4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785007:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42c4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612688.785113:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788612688.785217:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785232:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c46 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785239:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785245:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdec00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612688.785250:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785257:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785280:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d500) 00010000:00010000:0.0:1788612688.785282:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612688.785288:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785294:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785308:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42c4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785314:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42c4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785320:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42c4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785325:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bde400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612688.785328:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42c4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785333:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42c4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785341:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff928e91fbb900) 00010000:00010000:0.0:1788612688.785343:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612688.785345:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42c4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785351:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42c4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785398:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af42c3f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd6c expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785409:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d500) 00010000:00010000:0.0:1788612688.785412:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612688.785416:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af42c3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd6c expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.785426:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf800, rc 0) 00000100:00100000:0.0:1788612688.785497:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4888723e-f23f-4213-998f-bea11838d5b1+10:14430:x1875495893454208:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 736us (1448us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788612688.785505:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 25 00000100:00100000:0.0:1788612688.792923:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612688.793025:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893454336 00000100:00100000:2.0:1788612688.793036:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893454336 00000100:00100000:2.0:1788612688.793098:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:2.0:1788612688.793109:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4888723e-f23f-4213-998f-bea11838d5b1+10:14430:x1875495893454336:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1788612688.793132:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612688.793167:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9200/0xfc956d548af42c5b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd73 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.793267:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c62 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.793282:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.793295:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612688.793320:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788612688.793324:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788612688.793342:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.793384:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9200/0xfc956d548af42c5b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd73 expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.793403:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd73 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.793412:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff928e9231d600) 00010000:00010000:2.0:1788612688.793416:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612688.793420:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ec21e9a00, rc 0) 00000100:00100000:2.0:1788612688.793483:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4888723e-f23f-4213-998f-bea11838d5b1+11:14430:x1875495893454336:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 375us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612688.793490:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:1.0:1788612688.801167:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612688.801269:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893454464 00000100:00100000:3.0:1788612688.801280:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893454464 00000100:00100000:3.0:1788612688.801342:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:3.0:1788612688.801353:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4888723e-f23f-4213-998f-bea11838d5b1+11:14430:x1875495893454464:12345-192.168.202.6@tcp:37:lfs.0 00000100:00100000:1.0:1788612688.806719:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4888723e-f23f-4213-998f-bea11838d5b1+11:14430:x1875495893454464:12345-192.168.202.6@tcp:37:lfs.0 Request processed in 5359us (5565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612688.806736:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:0.0:1788612688.809782:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612688.809866:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893454720 00000100:00100000:2.0:1788612688.809875:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893454720 00000100:00100000:2.0:1788612688.809931:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:2.0:1788612688.809940:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e82c40850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4888723e-f23f-4213-998f-bea11838d5b1+11:14430:x1875495893454720:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1788612688.810177:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e82c40850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4888723e-f23f-4213-998f-bea11838d5b1+12:14430:x1875495893454720:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 236us (401us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788612688.810185:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:3.0:1788612688.856675:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612688.856768:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893454848 00000100:00100000:0.0:1788612688.856780:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893454848 00000100:00100000:0.0:1788612688.856885:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:0.0:1788612688.856905:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+10:14436:x1875495893454848:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1788612688.856926:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612688.856945:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42c69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd7a expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857021:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857036:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857063:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857077:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42c77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857084:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857090:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857383:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af42c7e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857392:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af42c7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857399:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af42c7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612688.857426:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788612688.857429:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612688.857466:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af42c7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857478:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857484:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857502:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857507:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdec00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612688.857511:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857518:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857529:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d500) 00010000:00010000:0.0:1788612688.857532:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612688.857537:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857543:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdec00/0xfc956d548af42c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857567:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857573:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42c77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857579:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42c77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857583:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea7bdf400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612688.857586:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42c77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857602:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42c77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857611:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff928e91fbb900) 00010000:00010000:0.0:1788612688.857613:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612688.857616:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42c77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857622:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf400/0xfc956d548af42c77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857656:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bde400/0xfc956d548af42c69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd7a expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857669:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf800/0xfc956d548af42c7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd7a expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.857676:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff928e9231d600) 00010000:00010000:0.0:1788612688.857677:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788612688.857680:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea7bdf800, rc 0) 00000100:00100000:0.0:1788612688.857799:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+11:14436:x1875495893454848:12345-192.168.202.6@tcp:101:bash.0 Request processed in 896us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612688.857806:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:3.0:1788612688.861627:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612688.865379:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893455104 00000100:00100000:0.0:1788612688.865396:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893455104 00000100:00100000:0.0:1788612688.865593:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 28 00000100:00100000:0.0:1788612688.865606:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+11:14436:x1875495893455104:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1788612688.865646:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612688.865669:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c85 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd81 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.865794:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.865811:0:14378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c62 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd73 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.865821:0:14378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.865906:0:14378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd73 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612688.865920:0:14378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c62 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd73 expref: 11 pid: 14378 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612688.865932:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1875495914412672:192.168.202.6@tcp:104: 00000100:00100000:0.0:1788612688.866038:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d849cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612688.869384:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1875495914412672:192.168.202.6@tcp:104: 00010000:00010000:0.0:1788612688.869417:0:14378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612688.870934:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612688.871323:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893455232 00000100:00100000:2.0:1788612688.871332:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893455232 00010000:00010000:2.0:1788612688.871375:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c62 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd73 expref: 12 pid: 14378 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612688.871417:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:2.0:1788612688.871428:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4888723e-f23f-4213-998f-bea11838d5b1+12:2356:x1875495893455232:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612688.871456:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612688.871463:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c62 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd73 expref: 12 pid: 14378 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.871476:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd73 expref: 12 pid: 14378 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.871498:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9a00/0xfc956d548af42c62 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd73 expref: 12 pid: 14378 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.871513:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff928e9231d600) 00010000:00010000:2.0:1788612688.871518:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.871527:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.871534:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612688.871579:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612688.871634:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4888723e-f23f-4213-998f-bea11838d5b1+11:2356:x1875495893455232:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 206us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612688.871641:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00010000:00010000:3.0:1788612688.871949:0:14378:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.871958:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.871995:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e200/0xfc956d548af42c93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.872006:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e200/0xfc956d548af42c93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.872014:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e200/0xfc956d548af42c93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.872650:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f400/0xfc956d548af42c9a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.872660:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f400/0xfc956d548af42c9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.872667:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f400/0xfc956d548af42c9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612688.872678:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788612688.872707:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.872715:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.872721:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.872734:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d6800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612688.872739:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.872746:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.872757:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff928e9231d600) 00010000:00010000:3.0:1788612688.872760:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612688.872763:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.872770:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6800/0xfc956d548af42c8c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612688.872780:0:14378:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c75f0ad6 reply state 00000000f87301be transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e200/0xfc956d548af42c93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612688.872789:0:14378:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788612688.872820:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea7bdf200/0xfc956d548af42c85 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd81 expref: 14 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.872877:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f400/0xfc956d548af42c9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd81 expref: 13 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612688.872886:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:3.0:1788612688.872889:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788612688.872891:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928d8789f400, rc 0) 00000100:00100000:3.0:1788612688.872947:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+14:14436:x1875495893455104:12345-192.168.202.6@tcp:101:bash.0 Request processed in 7343us (11328us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788612688.872961:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 28 00010000:00010000:1.0:1788612688.879428:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e200/0xfc956d548af42c93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.879447:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e200/0xfc956d548af42c93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.879456:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e200/0xfc956d548af42c93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.879462:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928d8789e200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612688.879467:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e200/0xfc956d548af42c93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.879475:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e200/0xfc956d548af42c93 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.879507:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff928ea7bbc100) 00010000:00010000:1.0:1788612688.879510:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612688.879515:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e200/0xfc956d548af42c93 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.879521:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e200/0xfc956d548af42c93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612688.886639:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612688.886726:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893455360 00000100:00100000:1.0:1788612688.886736:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893455360 00000100:00100000:1.0:1788612688.886792:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:1.0:1788612688.886801:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+13:14436:x1875495893455360:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1788612688.886823:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612688.887213:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42ca8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd88 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.887296:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42caf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.887309:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42caf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.887321:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42caf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612688.887358:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788612688.887362:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788612688.887385:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42caf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.887411:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42caf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.887435:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42ca8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd88 expref: 15 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.887455:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42caf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd88 expref: 14 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.887463:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:1.0:1788612688.887466:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612688.887470:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0145000, rc 0) 00000100:00100000:1.0:1788612688.887541:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+14:14436:x1875495893455360:12345-192.168.202.6@tcp:101:bash.0 Request processed in 739us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612688.887558:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 29 00000100:00100000:0.0:1788612688.892235:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612688.892376:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893455616 00000100:00100000:2.0:1788612688.892386:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893455616 00000100:00100000:2.0:1788612688.892439:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:2.0:1788612688.892450:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+14:14436:x1875495893455616:12345-192.168.202.6@tcp:35:bash.0 00000100:00100000:2.0:1788612688.892810:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+15:14436:x1875495893455616:12345-192.168.202.6@tcp:35:bash.0 Request processed in 361us (583us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788612688.892818:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:3.0:1788612688.998741:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612688.998900:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893455872 00000100:00100000:1.0:1788612688.998910:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893455872 00000100:00100000:1.0:1788612688.998976:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:1.0:1788612688.998988:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+15:14446:x1875495893455872:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1788612688.999013:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612688.999034:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42cb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd8f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612688.999126:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788612688.999257:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42cb6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd8f expref: 17 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.999291:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff928e9231d500) 00010000:00010000:1.0:1788612688.999294:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612688.999301:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42cb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd8f expref: 17 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612688.999315:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0145400, rc 0) 00000100:00100000:1.0:1788612688.999512:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+16:14446:x1875495893455872:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 526us (781us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788612688.999519:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:3.0:1788612689.003196:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612689.003589:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893456128 00000100:00100000:2.0:1788612689.003600:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893456128 00000100:00100000:2.0:1788612689.003676:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:2.0:1788612689.003688:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+16:14446:x1875495893456128:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1788612689.003948:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+17:14446:x1875495893456128:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 263us (762us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788612689.003956:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00080000:0.0:1788612689.004064:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612689.042102:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612689.042245:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893456384 00000100:00100000:1.0:1788612689.042256:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893456384 00000100:00100000:1.0:1788612689.042319:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:1.0:1788612689.042330:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+17:14449:x1875495893456384:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1788612689.042350:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612689.042371:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42cc4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd96 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.042462:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42ccb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.042475:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42ccb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.042484:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42ccb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612689.042492:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788612689.042642:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42cc4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd96 expref: 20 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.042665:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42ccb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd96 expref: 19 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.042675:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:1.0:1788612689.042678:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612689.042681:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0144200, rc 0) 00000100:00100000:1.0:1788612689.042797:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+19:14449:x1875495893456384:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 467us (700us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788612689.042805:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:3.0:1788612689.046360:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612689.046535:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893456512 00000100:00100000:0.0:1788612689.046556:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893456512 00000100:00100000:0.0:1788612689.046618:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:0.0:1788612689.046629:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+19:14449:x1875495893456512:12345-192.168.202.6@tcp:54:lfs.0 00010000:00010000:0.0:1788612689.046696:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6a00/0xfc956d548af42cd9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.046712:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6a00/0xfc956d548af42cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.046725:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6a00/0xfc956d548af42cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.046751:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6a00/0xfc956d548af42cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.046758:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6a00/0xfc956d548af42cd9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.046764:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6a00/0xfc956d548af42cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.046769:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d6a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:0.0:1788612689.046773:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6a00/0xfc956d548af42cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.046780:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6a00/0xfc956d548af42cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.046791:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:0.0:1788612689.046794:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612689.046813:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6a00/0xfc956d548af42cd9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.046819:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6a00/0xfc956d548af42cd9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612689.047284:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+19:14449:x1875495893456512:12345-192.168.202.6@tcp:54:lfs.0 Request processed in 655us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.047292:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 32 00000100:00100000:3.0:1788612689.048937:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612689.049113:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893456640 00000100:00100000:2.0:1788612689.049121:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893456640 00000100:00100000:2.0:1788612689.049181:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:2.0:1788612689.049190:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+19:2355:x1875495893456640:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612689.049204:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612689.049225:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42ccb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd96 expref: 19 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612689.049242:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:2.0:1788612689.049246:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612689.049292:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+18:2355:x1875495893456640:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 103us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612689.049298:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1788612689.051953:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612689.052279:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893456896 00000100:00100000:2.0:1788612689.052291:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893456896 00000100:00100000:2.0:1788612689.052343:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:2.0:1788612689.052367:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+18:14449:x1875495893456896:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1788612689.052619:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+19:14449:x1875495893456896:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 253us (673us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788612689.052628:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:3.0:1788612689.263748:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612689.263922:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893457152 00000100:00100000:1.0:1788612689.263932:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893457152 00000100:00100000:1.0:1788612689.264067:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:1.0:1788612689.264080:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+19:14480:x1875495893457152:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:1.0:1788612689.264105:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612689.264127:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42ce0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddd9d expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.264232:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42ce7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.264247:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.264262:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612689.264291:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788612689.264798:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42ce0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd9d expref: 22 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.264821:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd9d expref: 21 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.264829:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:1.0:1788612689.264832:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612689.264936:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0144200, rc 0) 00000100:00100000:1.0:1788612689.265011:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+21:14480:x1875495893457152:12345-192.168.202.6@tcp:101:cat.0 Request processed in 934us (1275us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788612689.265019:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 33 00000100:00100000:3.0:1788612689.270872:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612689.270978:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893457408 00000100:00100000:2.0:1788612689.270989:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893457408 00000100:00100000:2.0:1788612689.271047:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:2.0:1788612689.271058:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+21:14480:x1875495893457408:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:2.0:1788612689.271411:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+22:14480:x1875495893457408:12345-192.168.202.6@tcp:35:cat.0 Request processed in 354us (574us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788612689.271419:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 8 00000100:00100000:3.0:1788612689.280990:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612689.283280:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893457536 00000100:00100000:0.0:1788612689.283295:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893457536 00000100:00100000:0.0:1788612689.283375:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:0.0:1788612689.283384:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+22:2355:x1875495893457536:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612689.283401:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612689.283425:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42ce7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd9d expref: 22 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.283445:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:0.0:1788612689.283449:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612689.283581:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+21:2355:x1875495893457536:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 197us (2704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.283588:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00010000:00010000:2.0:1788612689.324269:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612689.358637:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612689.358810:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893457792 00000100:00100000:1.0:1788612689.358821:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893457792 00000100:00100000:1.0:1788612689.358989:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:1.0:1788612689.359001:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+21:14486:x1875495893457792:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1788612689.359024:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612689.359046:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42cf5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddda4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.359160:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af42cfc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.359176:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f400/0xfc956d548af42c9a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd81 expref: 22 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.359202:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42caf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd88 expref: 22 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.359211:0:14377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af42cfc lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.359407:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42caf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd88 expref: 22 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.359421:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42caf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd88 expref: 22 pid: 14379 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612689.359434:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1875495914412800:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612689.359597:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f400/0xfc956d548af42c9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd81 expref: 22 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.359608:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f400/0xfc956d548af42c9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd81 expref: 22 pid: 14378 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612689.359617:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1875495914412928:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612689.359641:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e91082d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612689.363618:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1875495914412800:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612689.363636:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1875495914412928:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612689.363665:0:14377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af42cfc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612689.363893:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612689.363925:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612689.363993:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893457920 00000100:00100000:0.0:1788612689.364001:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893457920 00010000:00010000:0.0:1788612689.364043:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f400/0xfc956d548af42c9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd81 expref: 23 pid: 14378 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612689.364081:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893458048 00000100:00100000:0.0:1788612689.364085:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893458048 00010000:00010000:0.0:1788612689.364108:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42caf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd88 expref: 24 pid: 14379 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612689.364126:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:0.0:1788612689.364135:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eaf487450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+24:2356:x1875495893457920:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612689.364161:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612689.364168:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f400/0xfc956d548af42c9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd81 expref: 24 pid: 14378 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.364179:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f400/0xfc956d548af42c9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd81 expref: 24 pid: 14378 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.364202:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f400/0xfc956d548af42c9a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd81 expref: 24 pid: 14378 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.364219:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:0.0:1788612689.364224:0:14363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af42cfc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.364231:0:14363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af42cfc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.364237:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612689.364289:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eaf487450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+23:2356:x1875495893457920:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 154us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.364297:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:0.0:1788612689.364338:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:0.0:1788612689.364345:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+22:2356:x1875495893458048:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612689.364359:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612689.364364:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42caf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd88 expref: 22 pid: 14379 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.364375:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42caf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd88 expref: 22 pid: 14379 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.364387:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42caf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddd88 expref: 22 pid: 14379 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.364398:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:0.0:1788612689.364402:0:14363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af42cfc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.364411:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af42cfc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.364419:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af42cfc lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.364443:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612689.364461:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+21:2356:x1875495893458048:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 116us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.364467:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00010000:00010000:0.0:1788612689.364486:0:14377:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af42cfc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.364493:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af42cfc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612689.364522:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788612689.364692:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42cf5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddda4 expref: 22 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.364708:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145c00/0xfc956d548af42cfc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddda4 expref: 21 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.364715:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:0.0:1788612689.364717:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788612689.364720:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0145c00, rc 0) 00000100:00100000:0.0:1788612689.364745:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+21:14486:x1875495893457792:12345-192.168.202.6@tcp:101:dd.0 Request processed in 5747us (6119us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788612689.364752:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 34 00000100:00100000:3.0:1788612689.367661:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612689.367759:0:16599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893458304 00000100:00100000:2.0:1788612689.367770:0:16599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893458304 00000100:00100000:2.0:1788612689.367862:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 35 00000100:00100000:2.0:1788612689.367873:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+21:14486:x1875495893458304:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:2.0:1788612689.368141:0:16599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af42d0a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612689.368394:0:16599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af42d0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612689.368407:0:16599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af42d0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788612689.368465:0:16599:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788612689.368505:0:16599:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011ae0cac reply state 00000000345ddcd5 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af42d0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612689.368533:0:16599:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788612689.368646:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+24:14486:x1875495893458304:12345-192.168.202.6@tcp:36:dd.0 Request processed in 774us (993us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788612689.368653:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 35 00000020:00080000:2.0:1788612689.368659:0:16599:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788612689.374275:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af42d0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.374293:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af42d0a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.374301:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af42d0a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.374307:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612689.374312:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af42d0a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.374321:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af42d0a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.374337:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:1.0:1788612689.374341:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612689.374346:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af42d0a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.374353:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ec21e9800/0xfc956d548af42d0a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612689.376164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612689.376276:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893458432 00000100:00100000:0.0:1788612689.376287:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893458432 00000100:00100000:0.0:1788612689.376347:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:0.0:1788612689.376358:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+23:14486:x1875495893458432:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1788612689.376381:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612689.376400:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6a00/0xfc956d548af42d11 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dddab expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.376462:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6a00/0xfc956d548af42d11 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddab expref: 24 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.376477:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6a00/0xfc956d548af42d11 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddab expref: 24 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.376512:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:0.0:1788612689.376516:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788612689.376520:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d6a00, rc 0) 00000100:00100000:0.0:1788612689.376593:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+24:14486:x1875495893458432:12345-192.168.202.6@tcp:101:dd.0 Request processed in 236us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.376600:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 36 00000100:00100000:3.0:1788612689.401264:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612689.401422:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893458688 00000100:00100000:0.0:1788612689.401433:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893458688 00000100:00100000:0.0:1788612689.401515:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:0.0:1788612689.401526:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+24:14486:x1875495893458688:12345-192.168.202.6@tcp:103:dd.0 00010000:00010000:0.0:1788612689.401551:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612689.401575:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6a00/0xfc956d548af42d11 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddab expref: 24 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.401595:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:0.0:1788612689.401601:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612689.401662:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+23:14486:x1875495893458688:12345-192.168.202.6@tcp:103:dd.0 Request processed in 137us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.401669:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:3.0:1788612689.403599:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612689.403703:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893458816 00000100:00100000:1.0:1788612689.403712:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893458816 00000100:00100000:1.0:1788612689.403770:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:1.0:1788612689.403779:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+23:14486:x1875495893458816:12345-192.168.202.6@tcp:58:dd.0 00010000:00010000:1.0:1788612689.403916:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145a00/0xfc956d548af42d18 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.403953:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145a00/0xfc956d548af42d18 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.403966:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145a00/0xfc956d548af42d18 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612689.404737:0:14379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612689.404927:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788612689.405002:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788612689.405119:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+23:14486:x1875495893458816:12345-192.168.202.6@tcp:58:dd.0 Request processed in 1338us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612689.405127:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 37 00000100:00100000:3.0:1788612689.407989:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612689.408267:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893458944 00000100:00100000:0.0:1788612689.408278:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893458944 00000100:00100000:0.0:1788612689.408337:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:0.0:1788612689.408347:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+23:14486:x1875495893458944:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1788612689.408367:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612689.408389:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7000/0xfc956d548af42d1f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dddb2 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.408473:0:14378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145a00/0xfc956d548af42d18 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.408486:0:14378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7000/0xfc956d548af42d1f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddb2 expref: 24 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.408506:0:14378:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145a00/0xfc956d548af42d18 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.408519:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7000/0xfc956d548af42d1f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddb2 expref: 24 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.408531:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:0.0:1788612689.408535:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788612689.408538:0:14378:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7000/0xfc956d548af42d1f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddb2 expref: 24 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.408557:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d7000, rc 0) 00000100:00100000:0.0:1788612689.408617:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+24:14486:x1875495893458944:12345-192.168.202.6@tcp:101:dd.0 Request processed in 272us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.408625:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 38 00000100:00100000:2.0:1788612689.452281:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadeaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914413056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612689.452350:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612689.452504:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914413184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612689.452529:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612689.452616:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914413056 00000100:00100000:3.0:1788612689.452624:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914413056 00000100:00100000:3.0:1788612689.452679:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914413184 00000100:00100000:3.0:1788612689.452682:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914413184 00000100:00100000:3.0:1788612689.452696:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788612689.452704:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914413056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612689.452737:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612689.452777:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875495914413056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612689.452784:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788612689.452812:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788612689.452817:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914413184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612689.452870:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788612689.452910:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914413184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612689.452916:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788612689.453054:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612689.453058:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612689.453089:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914413184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612689.453115:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadeaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875495914413056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612689.453250:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914413696:0@lo:400:kworker.0 00000100:00100000:0.0:1788612689.453279:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612689.453299:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612689.453304:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadeab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8d85c8a-0380-4a63-8187-d0137cefd572:3305:1875495914413312:0@lo:400:kworker.0 00000100:00100000:0.0:1788612689.453327:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612689.453363:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914413568:0@lo:400:kworker.0 00000100:00100000:0.0:1788612689.453381:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612689.453393:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612689.453397:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eadea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914413440:0@lo:400:kworker.0 00000100:00100000:0.0:1788612689.453412:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612689.453430:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914413696 00000100:00100000:0.0:1788612689.453434:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914413696 00000100:00100000:0.0:1788612689.453463:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914413568 00000100:00100000:0.0:1788612689.453465:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914413568 00000100:00100000:0.0:1788612689.453475:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914413440 00000100:00100000:0.0:1788612689.453477:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914413440 00000100:00100000:0.0:1788612689.453487:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612689.453493:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914413696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612689.453525:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875495914413696:12345-0@lo:400:kworker.0 Request processed in 33us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.453531:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612689.453555:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612689.453561:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914413568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612689.453593:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875495914413568:12345-0@lo:400:kworker.0 Request processed in 32us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.453599:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612689.453610:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788612689.453615:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadeab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914413440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612689.453641:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadeab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875495914413440:12345-0@lo:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.453646:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788612689.453660:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612689.453685:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875495914413440:0@lo:400:kworker.0 00000100:00100000:0.0:1788612689.453695:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875495914413568:0@lo:400:kworker.0 00000100:00100000:0.0:1788612689.453717:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875495914413696:0@lo:400:kworker.0 00000100:00100000:1.0:1788612689.454593:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914413312 00000100:00100000:1.0:1788612689.454602:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914413312 00000100:00100000:1.0:1788612689.454644:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788612689.454653:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+19:3305:x1875495914413312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612689.454707:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8d85c8a-0380-4a63-8187-d0137cefd572+19:3305:x1875495914413312:12345-0@lo:400:kworker.0 Request processed in 55us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612689.454714:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788612689.454759:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eadeab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8d85c8a-0380-4a63-8187-d0137cefd572:3305:1875495914413312:0@lo:400:kworker.0 00000040:00080000:3.0:1788612689.772377:0:14411:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788612689.772386:0:14411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612689.772425:0:14411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788612689.772432:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788612689.772586:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ebfc35880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14411:1875495914413824:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788612689.772711:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d87220d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612689.777913:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ebfc35880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14411:1875495914413824:192.168.202.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788612689.787715:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612689.791671:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893459072 00000100:00100000:0.0:1788612689.791688:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893459072 00000100:00100000:0.0:1788612689.791759:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:0.0:1788612689.791770:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a69c66e5-135a-4565-b61a-424712bcbd1e+24:14487:x1875495893459072:12345-192.168.202.6@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788612689.791893:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a69c66e5-135a-4565-b61a-424712bcbd1e+24:14487:x1875495893459072:12345-192.168.202.6@tcp:900:lhsmtool_posix.0 Request processed in 124us (4187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.791901:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1788612689.794517:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612689.794628:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893459200 00000100:00100000:1.0:1788612689.794638:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893459200 00000100:00100000:1.0:1788612689.794700:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:1.0:1788612689.794712:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ebfc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+24:14487:x1875495893459200:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788612689.794766:0:14378:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788612689.794912:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ebfc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+24:14487:x1875495893459200:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 201us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612689.794929:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 39 00000100:00100000:2.0:1788612689.807970:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612689.808070:0:16599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893459328 00000100:00100000:3.0:1788612689.808080:0:16599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893459328 00000100:00100000:3.0:1788612689.808149:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:3.0:1788612689.808159:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+24:14487:x1875495893459328:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788612689.808243:0:16599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f800/0xfc956d548af42d26 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.808260:0:16599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f800/0xfc956d548af42d26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.808272:0:16599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f800/0xfc956d548af42d26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.808338:0:16599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789ec00/0xfc956d548af42d2d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.808377:0:16599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789ec00/0xfc956d548af42d2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.808386:0:16599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789ec00/0xfc956d548af42d2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.808420:0:16599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e400/0xfc956d548af42d34 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.808430:0:16599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e400/0xfc956d548af42d34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.809938:0:16599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e400/0xfc956d548af42d34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612689.810013:0:16599:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788612689.810018:0:16599:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788612689.810038:0:16599:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e400/0xfc956d548af42d34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810052:0:16599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f800/0xfc956d548af42d26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810058:0:16599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f800/0xfc956d548af42d26 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810065:0:16599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f800/0xfc956d548af42d26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810071:0:16599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928d8789f800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612689.810076:0:16599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f800/0xfc956d548af42d26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810097:0:16599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f800/0xfc956d548af42d26 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810110:0:16599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb300) 00010000:00010000:3.0:1788612689.810113:0:16599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612689.810118:0:16599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f800/0xfc956d548af42d26 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810125:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789f800/0xfc956d548af42d26 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810140:0:16599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789ec00/0xfc956d548af42d2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810146:0:16599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789ec00/0xfc956d548af42d2d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810153:0:16599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789ec00/0xfc956d548af42d2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810158:0:16599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928d8789ec00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612689.810161:0:16599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789ec00/0xfc956d548af42d2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810167:0:16599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789ec00/0xfc956d548af42d2d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810173:0:16599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff928ea7bbc600) 00010000:00010000:3.0:1788612689.810176:0:16599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612689.810179:0:16599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789ec00/0xfc956d548af42d2d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810195:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789ec00/0xfc956d548af42d2d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810214:0:16599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e400/0xfc956d548af42d34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810220:0:16599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e400/0xfc956d548af42d34 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810225:0:16599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e400/0xfc956d548af42d34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810230:0:16599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928d8789e400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612689.810234:0:16599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e400/0xfc956d548af42d34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810239:0:16599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e400/0xfc956d548af42d34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810247:0:16599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:3.0:1788612689.810249:0:16599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612689.810252:0:16599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e400/0xfc956d548af42d34 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612689.810258:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928d8789e400/0xfc956d548af42d34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16599 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612689.810345:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+24:14487:x1875495893459328:12345-192.168.202.6@tcp:34:lhsmtool_posix.0 Request processed in 2183us (2382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612689.810896:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 40 00000100:00100000:3.0:1788612689.816045:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612689.816213:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893459584 00000100:00100000:1.0:1788612689.816224:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893459584 00000100:00100000:1.0:1788612689.816291:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:1.0:1788612689.816303:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+24:14487:x1875495893459584:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612689.816325:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612689.816346:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42d3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dddb9 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.816580:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d42 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.816608:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.816624:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612689.816634:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788612689.816728:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.816736:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.816743:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.816749:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0145000 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612689.816754:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.816776:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.816788:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:1.0:1788612689.816791:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788612689.816796:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d42 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.816802:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d42 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.816898:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42d3b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddb9 expref: 26 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.816909:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff928e91fbb300) 00010000:00010000:1.0:1788612689.816911:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612689.816915:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42d3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddb9 expref: 26 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.816924:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0145400, rc 0) 00000100:00100000:1.0:1788612689.816986:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+25:14487:x1875495893459584:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 686us (952us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788612689.816994:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 41 00000100:00100000:2.0:1788612689.828032:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612689.828259:0:16599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893459712 00000100:00100000:3.0:1788612689.828271:0:16599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893459712 00000100:00100000:3.0:1788612689.828334:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:3.0:1788612689.828344:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+25:14487:x1875495893459712:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788612689.828388:0:16599:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788612689.832106:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+25:14487:x1875495893459712:12345-192.168.202.6@tcp:53:lhsmtool_posix.0 Request processed in 3749us (4071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612689.832123:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 42 00000100:00100000:3.0:1788612689.850302:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612689.850897:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893459968 00000100:00100000:1.0:1788612689.850909:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893459968 00000100:00100000:1.0:1788612689.850973:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:1.0:1788612689.850984:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+25:14487:x1875495893459968:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612689.851020:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612689.851041:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42d50 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dddc0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788612689.852276:0:14378:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1788612689.852286:0:14378:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1788612689.852344:0:14378:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1788612689.854248:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d57 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.854271:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.854284:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.854355:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145400/0xfc956d548af42d50 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddc0 expref: 28 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.854376:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d57 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddc0 expref: 27 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.854385:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff928e838ce300) 00010000:00010000:1.0:1788612689.854388:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612689.854392:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928ea0145000, rc 0) 00000100:00100000:1.0:1788612689.854474:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+27:14487:x1875495893459968:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 3491us (4182us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788612689.854485:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 43 00000100:00100000:3.0:1788612689.860707:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612689.861501:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893460224 00000100:00100000:1.0:1788612689.861527:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893460224 00000100:00100000:1.0:1788612689.861598:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:1.0:1788612689.861608:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+27:14487:x1875495893460224:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788612689.861679:0:14379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612689.861704:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145000/0xfc956d548af42d57 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddc0 expref: 27 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861723:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff928e838ce300) 00010000:00010000:1.0:1788612689.861734:0:14379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612689.861756:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42d65 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861768:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42d65 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861778:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42d65 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861789:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030c00/0xfc956d548af42d6c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc6e79182 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861795:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030c00/0xfc956d548af42d6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc6e79182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861801:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030c00/0xfc956d548af42d6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc6e79182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861886:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42d65 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861894:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42d65 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861906:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42d65 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861912:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0144200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612689.861916:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42d65 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861924:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42d65 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861933:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff928e9231d600) 00010000:00010000:1.0:1788612689.861935:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612689.861939:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42d65 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861945:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0144200/0xfc956d548af42d65 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861955:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030c00/0xfc956d548af42d6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc6e79182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861960:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030c00/0xfc956d548af42d6c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc6e79182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861965:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030c00/0xfc956d548af42d6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc6e79182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861970:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030c00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612689.861973:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030c00/0xfc956d548af42d6c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc6e79182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861989:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030c00/0xfc956d548af42d6c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc6e79182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.861997:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc6e79182 (ffff928e838cef00) 00010000:00010000:1.0:1788612689.861999:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612689.862002:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030c00/0xfc956d548af42d6c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc6e79182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.862007:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030c00/0xfc956d548af42d6c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc6e79182 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612689.862089:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+26:14487:x1875495893460224:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 482us (1390us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788612689.862096:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 44 00000100:00100000:2.0:1788612689.864408:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612689.864491:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893460352 00000100:00100000:0.0:1788612689.864500:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893460352 00000100:00100000:0.0:1788612689.864554:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:0.0:1788612689.864563:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+26:14487:x1875495893460352:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612689.864580:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612689.864599:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7800/0xfc956d548af42d73 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dddc7 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.864630:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7400/0xfc956d548af42d7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.864642:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7400/0xfc956d548af42d7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.864652:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7400/0xfc956d548af42d7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.864743:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7800/0xfc956d548af42d73 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddc7 expref: 28 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.864759:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7400/0xfc956d548af42d7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddc7 expref: 27 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.864767:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff928e91fbb900) 00010000:00010000:0.0:1788612689.864770:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788612689.864773:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d7400, rc 0) 00000100:00100000:0.0:1788612689.864826:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+27:14487:x1875495893460352:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 264us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.864831:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 45 00000100:00100000:2.0:1788612689.871745:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612689.871862:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893460608 00000100:00100000:1.0:1788612689.871873:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893460608 00000100:00100000:1.0:1788612689.871937:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 46 00000100:00100000:1.0:1788612689.871948:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+27:14487:x1875495893460608:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788612689.872034:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42d81 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.872051:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42d81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.872073:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42d81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612689.872830:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1788612689.872885:0:14379:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 483716046922ns, next at 484716043880ns, rc = 0 00000004:00010000:1.0:1788612689.872993:0:14379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db09aadf reply state 00000000ada6afb8 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42d81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612689.873002:0:14379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788612689.878102:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+29:14487:x1875495893460608:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 6141us (6354us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788612689.878116:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 46 00010000:00010000:1.0:1788612689.887681:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42d81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.887701:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42d81 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.887710:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42d81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.887716:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80031800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612689.887723:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42d81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.887732:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42d81 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.887752:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff928e91fbb900) 00010000:00010000:1.0:1788612689.887756:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788612689.887762:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42d81 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612689.887768:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42d81 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612689.894488:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612689.894647:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893460736 00000100:00100000:0.0:1788612689.894660:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893460736 00000100:00100000:0.0:1788612689.894718:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:0.0:1788612689.894728:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+28:14487:x1875495893460736:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612689.894755:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612689.894777:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7800/0xfc956d548af42d88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dddce expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.894862:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7800/0xfc956d548af42d88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddce expref: 29 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.894878:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7800/0xfc956d548af42d88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddce expref: 29 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.894919:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff928e91fbb900) 00010000:00010000:0.0:1788612689.894923:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788612689.894927:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d7800, rc 0) 00000100:00100000:0.0:1788612689.894989:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+29:14487:x1875495893460736:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 262us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.894996:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 47 00000100:00100000:3.0:1788612689.907987:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612689.908319:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893460864 00000100:00100000:2.0:1788612689.908332:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893460864 00000100:00100000:2.0:1788612689.908416:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:2.0:1788612689.908427:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2355:x1875495893460864:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788612689.908819:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+6:2355:x1875495893460864:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 393us (841us total) trans 8589934594 rc 0/0 00000100:00080000:0.0:1788612689.908819:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612689.908827:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:2.0:1788612689.917102:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612689.917176:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893461120 00000100:00100000:0.0:1788612689.917186:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893461120 00000100:00100000:0.0:1788612689.917248:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:0.0:1788612689.917259:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+29:14487:x1875495893461120:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788612689.917511:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+30:14487:x1875495893461120:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 252us (420us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788612689.917519:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 9 00000100:00100000:3.0:1788612689.921184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612689.921483:0:16599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893461376 00000100:00100000:2.0:1788612689.921494:0:16599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893461376 00000100:00100000:2.0:1788612689.921559:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:2.0:1788612689.921569:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+30:14487:x1875495893461376:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788612689.921676:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+30:14487:x1875495893461376:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 108us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612689.921683:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 48 00000100:00100000:3.0:1788612689.924785:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612689.924907:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893461504 00000100:00100000:0.0:1788612689.924916:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893461504 00000100:00100000:0.0:1788612689.924971:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:0.0:1788612689.924981:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+30:14487:x1875495893461504:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612689.925001:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612689.925021:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6e00/0xfc956d548af42d8f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8dddd5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.925106:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6400/0xfc956d548af42d96 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.925137:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6400/0xfc956d548af42d96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.925160:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6400/0xfc956d548af42d96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612689.925201:0:14377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788612689.925219:0:14377:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6400/0xfc956d548af42d96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.925246:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6e00/0xfc956d548af42d8f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddd5 expref: 32 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.925264:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6400/0xfc956d548af42d96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddd5 expref: 31 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.925273:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff928e91fbb900) 00010000:00010000:0.0:1788612689.925276:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788612689.925280:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d6400, rc 0) 00000100:00100000:0.0:1788612689.925341:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+31:14487:x1875495893461504:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 362us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.925347:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 49 00000100:00100000:2.0:1788612689.931344:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612689.931494:0:16598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893461632 00000100:00100000:0.0:1788612689.931505:0:16598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893461632 00000100:00100000:0.0:1788612689.931566:0:16598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:0.0:1788612689.931576:0:16598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+6:2355:x1875495893461632:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612689.931595:0:16598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612689.931627:0:16598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e49a651/0xfc956d548af42d9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd237d00c2c8ddddc expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788612689.931655:0:16598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c1052, blocks: 0x1 00010000:00010000:0.0:1788612689.931687:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788612689.931693:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612689.931703:0:16598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e49a651/0xfc956d548af42d9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddddc expref: 7 pid: 16598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.931723:0:16598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e49a651/0xfc956d548af42d9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddddc expref: 7 pid: 16598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612689.931737:0:16598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff928e910d6e00, rc 0) 00000100:00100000:0.0:1788612689.931795:0:16598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+7:2355:x1875495893461632:12345-192.168.202.6@tcp:101:lhsmtool_posix.0 Request processed in 220us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.931802:0:16598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:3.0:1788612689.934735:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612689.934889:0:16599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893461888 00000100:00100000:0.0:1788612689.934900:0:16599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893461888 00000100:00100000:0.0:1788612689.934951:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:0.0:1788612689.934961:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+31:14487:x1875495893461888:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788612689.935316:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+31:14487:x1875495893461888:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 356us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612689.935325:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 50 00000100:00100000:3.0:1788612689.938176:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612689.938598:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893462016 00000100:00100000:1.0:1788612689.938609:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893462016 00000100:00100000:1.0:1788612689.938668:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1788612689.938679:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+31:14487:x1875495893462016:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788612689.999729:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:0.0:1788612689.999749:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000004:00080000:0.0:1788612689.999761:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788612689.999824:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788612690.000039:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+14:14487:x1875495893462016:12345-192.168.202.6@tcp:44:lhsmtool_posix.0 Request processed in 61355us (61864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612690.000050:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 51 00000100:00100000:1.0:1788612690.001407:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612690.001428:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914413952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788612690.001489:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612690.001685:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914413952 00000100:00100000:3.0:1788612690.001693:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914413952 00000100:00100000:3.0:1788612690.001745:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788612690.001754:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875495914413952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788612690.002122:0:15062:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788612690.002127:0:15062:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788612690.002129:0:15062:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788612690.002478:0:15062:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788612690 -> 1788612690 00002000:00010000:3.0:1788612690.002481:0:15062:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788612690.002552:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875495914413952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 798us (1061us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788612690.002577:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788612690.004517:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612690.004562:0:16598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893462144 00000100:00100000:3.0:1788612690.004571:0:16598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893462144 00000100:00100000:3.0:1788612690.004622:0:16598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:3.0:1788612690.004630:0:16598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+7:2356:x1875495893462144:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788612690.004724:0:16598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+7:2356:x1875495893462144:12345-192.168.202.6@tcp:16:lhsmtool_posix.0 Request processed in 94us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612690.004732:0:16598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:3.0:1788612690.006729:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612690.007058:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893462400 00000100:00100000:1.0:1788612690.007314:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893462400 00000100:00100000:1.0:1788612690.007381:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 52 00000100:00100000:1.0:1788612690.007516:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+14:14487:x1875495893462400:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788612690.007579:0:14379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612690.007606:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d6400/0xfc956d548af42d96 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddd5 expref: 14 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.007626:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff928e91fbb900) 00010000:00010000:1.0:1788612690.007632:0:14379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612690.007667:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42da4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.007680:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42da4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.007689:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42da4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612690.008355:0:14379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a24e2bc reply state 00000000882fac3e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42da4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612690.008384:0:14379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612690.008484:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+15:14487:x1875495893462400:12345-192.168.202.6@tcp:36:lhsmtool_posix.0 Request processed in 1092us (1762us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788612690.008492:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 52 00000004:00080000:0.0:1788612690.009861:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff928ec0995180/2, rc 0, transno 8589934595 00000100:00100000:0.0:1788612690.009883:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875495914413952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788612690.011822:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612690.011999:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893462528 00000100:00100000:2.0:1788612690.012008:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893462528 00000100:00100000:2.0:1788612690.012072:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:2.0:1788612690.012083:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+7:2355:x1875495893462528:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788612690.012277:0:15059:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788612690.012281:0:15059:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788612689 00002000:00010000:2.0:1788612690.012283:0:15059:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788612689 00002000:00010000:2.0:1788612690.012286:0:15059:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788612690 -> 1788612689 00002000:00010000:2.0:1788612690.012288:0:15059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788612690.012339:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+8:2355:x1875495893462528:12345-192.168.202.6@tcp:2:lhsmtool_posix.0 Request processed in 257us (525us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788612690.012347:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00010000:00010000:3.0:1788612690.012441:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42da4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.012450:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42da4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.012458:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42da4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.012464:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80031800 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:3.0:1788612690.012469:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42da4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.012477:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42da4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.012493:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff928e91fbb900) 00010000:00010000:3.0:1788612690.012496:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612690.012515:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42da4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.012522:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80031800/0xfc956d548af42da4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612690.014734:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612690.014802:0:16598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893462656 00000100:00100000:3.0:1788612690.014811:0:16598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893462656 00000100:00100000:3.0:1788612690.014888:0:16598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:3.0:1788612690.014898:0:16598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+8:2355:x1875495893462656:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788612690.014938:0:16598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020418455/0xfc956d548af42dab lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.014955:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612690.014959:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612690.014965:0:16598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020418455/0xfc956d548af42dab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.014980:0:16598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020418455/0xfc956d548af42dab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.015005:0:16598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020418455/0xfc956d548af42dab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.015013:0:16598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020418455/0xfc956d548af42dab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.015021:0:16598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020418455/0xfc956d548af42dab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.015040:0:16598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928d8789e400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612690.015044:0:16598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020418455/0xfc956d548af42dab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.015053:0:16598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020418455/0xfc956d548af42dab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.015268:0:16598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020418455/0xfc956d548af42dab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.015277:0:16598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020418455/0xfc956d548af42dab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612690.015348:0:16598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+8:2355:x1875495893462656:12345-192.168.202.6@tcp:1:lhsmtool_posix.0 Request processed in 451us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612690.015355:0:16598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:3.0:1788612690.017062:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612690.017251:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893462912 00000100:00100000:1.0:1788612690.017260:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893462912 00000100:00100000:1.0:1788612690.017316:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 53 00000100:00100000:1.0:1788612690.017326:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+14:14487:x1875495893462912:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788612690.017401:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42db2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.017418:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42db2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.017429:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42db2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.017690:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.017703:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7800/0xfc956d548af42d88 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddce expref: 15 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.017712:0:14377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.017747:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7800/0xfc956d548af42d88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddce expref: 15 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.017768:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7800/0xfc956d548af42d88 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddce expref: 15 pid: 14377 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612690.017783:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1875495914414080:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612690.017884:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d87f5e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788612690.021671:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1875495914414080:192.168.202.6@tcp:104: 00010000:00010000:3.0:1788612690.021708:0:14377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612690.022736:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612690.023010:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893463040 00000100:00100000:1.0:1788612690.023018:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893463040 00010000:00010000:1.0:1788612690.023061:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7800/0xfc956d548af42d88 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddce expref: 16 pid: 14377 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612690.023111:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:1.0:1788612690.023121:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0994700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+16:2356:x1875495893463040:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612690.023145:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612690.023153:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7800/0xfc956d548af42d88 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddce expref: 16 pid: 14377 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.023166:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7800/0xfc956d548af42d88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddce expref: 16 pid: 14377 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.023190:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7800/0xfc956d548af42d88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddce expref: 16 pid: 14377 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.023208:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff928e91fbb900) 00010000:00010000:1.0:1788612690.023214:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.023239:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.023248:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.023279:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612690.023332:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0994700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a69c66e5-135a-4565-b61a-424712bcbd1e+15:2356:x1875495893463040:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 212us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612690.023340:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00010000:00010000:3.0:1788612690.023504:0:14377:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.023513:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612690.023714:0:14377:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1788612690.023901:0:14377:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1788612690.023944:0:14377:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1788612690.024016:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928ec0995c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14377:1875495914414208:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788612690.024336:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612690.024364:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff928e86f8fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612690.024581:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914414208 00000100:00100000:0.0:1788612690.024588:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914414208 00000100:00100000:0.0:1788612690.024628:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612690.024637:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14377:x1875495914414208:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788612690.024720:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14377:x1875495914414208:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612690.024728:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612690.024956:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928ec0995c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14377:1875495914414208:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788612690.026695:0:14377:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788612690.026790:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14377:1875495914414336:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788612690.026877:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612690.026898:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d87f5e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788612690.027411:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914414336 00000100:00100000:0.0:1788612690.027419:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914414336 00000100:00100000:0.0:1788612690.027468:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612690.027477:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eab92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14377:x1875495914414336:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788612690.027668:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eab92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14377:x1875495914414336:12345-0@lo:1000:mdt00_000.0 Request processed in 191us (790us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788612690.027676:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612690.028451:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14377:1875495914414336:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788612690.028494:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028504:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028511:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028517:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030200 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612690.028521:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028556:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028571:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff928e91fbb900) 00010000:00010000:1.0:1788612690.028574:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612690.028579:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028585:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030200/0xfc956d548af42db9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028615:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145a00/0xfc956d548af42d18 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028620:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145a00/0xfc956d548af42d18 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028626:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145a00/0xfc956d548af42d18 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028631:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ea0145a00 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612690.028634:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145a00/0xfc956d548af42d18 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028639:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145a00/0xfc956d548af42d18 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028646:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:1.0:1788612690.028648:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788612690.028655:0:14377:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7000/0xfc956d548af42d1f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddb2 expref: 18 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028678:0:14377:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7000/0xfc956d548af42d1f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddb2 expref: 18 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028687:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7000/0xfc956d548af42d1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddb2 expref: 18 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.028720:0:14377:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7000/0xfc956d548af42d1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8dddb2 expref: 18 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612690.028734:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1875495914414464:192.168.202.6@tcp:105: 00000100:00100000:1.0:1788612690.029160:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d87220f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612690.033208:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612690.033298:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1875495914414464:192.168.202.6@tcp:105: 00010000:00010000:1.0:1788612690.033326:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145a00/0xfc956d548af42d18 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033337:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928ea0145a00/0xfc956d548af42d18 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033368:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42dc0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033381:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42dc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033392:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42dc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033403:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42dc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033420:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42dc0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033427:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42dc0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033432:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030600 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612690.033436:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42dc0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033443:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42dc0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033454:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:1.0:1788612690.033457:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612690.033461:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42dc0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033467:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030600/0xfc956d548af42dc0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033476:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42db2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033481:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42db2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033487:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42db2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033492:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030400 already unused, calling callback (ffffffffc1e374f0) 00010000:00010000:1.0:1788612690.033498:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42db2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033504:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42db2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033511:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff928ea7bbcb00) 00010000:00010000:1.0:1788612690.033513:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788612690.033516:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42db2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.033521:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e80030400/0xfc956d548af42db2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612690.033780:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+18:14487:x1875495893462912:12345-192.168.202.6@tcp:57:lhsmtool_posix.0 Request processed in 16455us (16726us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788612690.033790:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 53 00000020:00080000:1.0:1788612690.033796:0:14377:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788612690.034079:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893463168 00000100:00100000:0.0:1788612690.034088:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893463168 00000100:00100000:0.0:1788612690.034126:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00000100:00100000:0.0:1788612690.034134:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928e82c43050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+18:14486:x1875495893463168:12345-192.168.202.6@tcp:49:dd.0 00000100:00100000:0.0:1788612690.034228:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928e82c43050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+18:14486:x1875495893463168:12345-192.168.202.6@tcp:49:dd.0 Request processed in 94us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612690.034235:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00000040:00080000:3.0:1788612690.034743:0:14411:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788612690.034748:0:14411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788612690.034789:0:14411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788612690.034794:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788612690.038542:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612690.038639:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893463424 00000100:00100000:0.0:1788612690.038649:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893463424 00000100:00100000:0.0:1788612690.038706:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:0.0:1788612690.038731:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+18:14487:x1875495893463424:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788612690.043250:0:14381:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788612690.043388:0:14381:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788612690.043459:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7200/0xfc956d548af42dc7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.043477:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7200/0xfc956d548af42dc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.043488:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7200/0xfc956d548af42dc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.043497:0:14381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7200/0xfc956d548af42dc7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.043503:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7200/0xfc956d548af42dc7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.043510:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7200/0xfc956d548af42dc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.043547:0:14381:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788612690.043665:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+20:14487:x1875495893463424:12345-192.168.202.6@tcp:35:lhsmtool_posix.0 Request processed in 4931us (5137us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788612690.043676:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000020:00080000:0.0:1788612690.043681:0:14381:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788612690.044002:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612690.044017:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7200/0xfc956d548af42dc7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.044025:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612690.044029:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7200/0xfc956d548af42dc7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.044037:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7200/0xfc956d548af42dc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.044051:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff928e91fbb900) 00010000:00010000:2.0:1788612690.044054:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788612690.044059:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7200/0xfc956d548af42dc7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.044073:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff928e910d7200/0xfc956d548af42dc7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.044086:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612690.044088:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612690.044089:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612690.221461:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612690.221502:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612690.221603:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893463680 00000100:00100000:1.0:1788612690.221614:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893463680 00000100:00100000:1.0:1788612690.221677:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893463808 00000100:00100000:1.0:1788612690.221681:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893463808 00000100:00100000:1.0:1788612690.221701:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:1.0:1788612690.221709:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+9:2353:x1875495893463680:12345-192.168.202.6@tcp:4:dd.0 00010000:00010000:1.0:1788612690.221741:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42dce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.221762:0:15066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e49a651/0xfc956d548af42d9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddddc expref: 9 pid: 16598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.221788:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788612690.221792:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612690.221797:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42dce lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.221832:0:15066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e49a651/0xfc956d548af42d9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddddc expref: 9 pid: 16598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.221888:0:15066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e49a651/0xfc956d548af42d9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddddc expref: 9 pid: 16598 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612690.221902:0:15066:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff928eab92f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:15066:1875495914414592:192.168.202.6@tcp:104: 00000100:00100000:1.0:1788612690.221983:0:15066:0:(client.c:2716:ptlrpc_set_wait()) set ffff928d87220540 going to sleep for 11 seconds 00000100:00100000:3.0:1788612690.223594:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612690.223691:0:15065:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788612690.223700:0:15065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788612690.223972:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893463552 00000100:00100000:3.0:1788612690.223981:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893463552 00000100:00100000:0.0:1788612690.224687:0:16602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:0.0:1788612690.224700:0:16602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec039d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+10:2354:x1875495893463808:12345-192.168.202.6@tcp:4:dd.0 00010000:00010000:0.0:1788612690.224743:0:16602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa495828/0xfc956d548af42dd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.224764:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612690.224769:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612690.224775:0:16602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa495828/0xfc956d548af42dd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.224786:0:16602:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aa495828/0xfc956d548af42dd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612690.228054:0:15066:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff928eab92f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:15066:1875495914414592:192.168.202.6@tcp:104: 00010000:00010000:1.0:1788612690.228086:0:15066:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42dce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612690.235987:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1788612690.236291:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893463936 00000100:00100000:2.0:1788612690.236302:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893463936 00010000:00010000:2.0:1788612690.236349:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e49a651/0xfc956d548af42d9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddddc expref: 11 pid: 16598 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612690.236391:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:2.0:1788612690.236402:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0997800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+11:2355:x1875495893463936:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612690.236417:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612690.236452:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e49a651/0xfc956d548af42d9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddddc expref: 11 pid: 16598 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.236467:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e49a651/0xfc956d548af42d9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddddc expref: 11 pid: 16598 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.236491:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e49a651/0xfc956d548af42d9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0xd237d00c2c8ddddc expref: 11 pid: 16598 timeout: 584 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.236508:0:14362:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612690.236512:0:14362:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612690.236518:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42dce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.236528:0:14362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42dce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.236548:0:14362:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612690.236551:0:14362:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612690.236555:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa495828/0xfc956d548af42dd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.236563:0:14362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa495828/0xfc956d548af42dd5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.236609:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612690.236655:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0997800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+10:2355:x1875495893463936:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 255us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612690.236670:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00010000:00010000:3.0:1788612690.236870:0:15066:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42dce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.236880:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42dce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.238453:0:16602:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aa495828/0xfc956d548af42dd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.238470:0:16602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa495828/0xfc956d548af42dd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788612690.332086:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1788612690.332108:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1788612690.332419:0:15066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1788612690.332424:0:15066:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788612689 -> 1788612690 00002000:00010000:1.0:1788612690.332427:0:15066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:1.0:1788612690.332442:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42dce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.332455:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42dce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.332479:0:15066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42dce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.332486:0:15066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:1.0:1788612690.332491:0:15066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42dce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.332501:0:15066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42dce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.332760:0:15066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42dce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.332769:0:15066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42dce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612690.332970:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+10:2353:x1875495893463680:12345-192.168.202.6@tcp:4:dd.0 Request processed in 111257us (111514us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788612690.332981:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:1.0:1788612690.333016:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:1.0:1788612690.333031:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+9:2353:x1875495893463552:12345-192.168.202.6@tcp:4:dd.0 00010000:00010000:1.0:1788612690.333062:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42ddc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.333074:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612690.333085:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612690.333091:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42ddc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.333104:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42ddc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.352581:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612690.404963:0:16602:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:2.0:1788612690.404985:0:16602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa495828/0xfc956d548af42dd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.404999:0:16602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa495828/0xfc956d548af42dd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.405009:0:16602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa495828/0xfc956d548af42dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.405017:0:16602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7c00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612690.405022:0:16602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa495828/0xfc956d548af42dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.405032:0:16602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa495828/0xfc956d548af42dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.405054:0:16602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa495828/0xfc956d548af42dd5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.405062:0:16602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa495828/0xfc956d548af42dd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612690.405170:0:16602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec039d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+11:2354:x1875495893463808:12345-192.168.202.6@tcp:4:dd.0 Request processed in 180469us (183662us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788612690.405198:0:16602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00000001:00080000:2.0:1788612690.405663:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000100:00100000:0.0:1788612690.414791:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612690.414945:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893464064 00000100:00100000:1.0:1788612690.414957:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893464064 00000100:00100000:1.0:1788612690.415033:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00000100:00100000:1.0:1788612690.415044:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+9:2355:x1875495893464064:12345-192.168.202.6@tcp:4:dd.0 00010000:00010000:1.0:1788612690.415077:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42de3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.415094:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612690.415098:0:15065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612690.415105:0:15065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42de3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.415118:0:15065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42de3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612690.421594:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612690.421643:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612690.421683:0:15067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788612690.421692:0:15067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788612690.421863:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893464192 00000100:00100000:3.0:1788612690.422055:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893464192 00000100:00100000:3.0:1788612690.422111:0:15067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788612690.422117:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893464320 00000100:00100000:3.0:1788612690.422120:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893464320 00000100:00100000:3.0:1788612690.423811:0:16604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:3.0:1788612690.423829:0:16604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a69c66e5-135a-4565-b61a-424712bcbd1e+12:2355:x1875495893464192:12345-192.168.202.6@tcp:4:dd.0 00010000:00010000:3.0:1788612690.423967:0:16604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055a4e916/0xfc956d548af42dea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.423988:0:16604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612690.423993:0:16604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612690.424000:0:16604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055a4e916/0xfc956d548af42dea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.424016:0:16604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055a4e916/0xfc956d548af42dea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612690.425195:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1788612690.425229:0:15067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1788612690.428479:0:15067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1788612690.429104:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1788612690.429695:0:16602:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788612690.429709:0:16602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893464448 00000100:00100000:1.0:1788612690.429718:0:16602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893464448 00000100:00100000:1.0:1788612690.429778:0:16602:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788612690.429783:0:16602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893464576 00000100:00100000:1.0:1788612690.429786:0:16602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893464576 00000100:00100000:1.0:1788612690.430368:0:16605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:1.0:1788612690.430387:0:16605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a69c66e5-135a-4565-b61a-424712bcbd1e+15:2355:x1875495893464320:12345-192.168.202.6@tcp:4:dd.0 00010000:00010000:1.0:1788612690.430423:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000270bc78e/0xfc956d548af42df1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.430439:0:16605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612690.430444:0:16605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612690.430451:0:16605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000270bc78e/0xfc956d548af42df1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612690.430465:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000270bc78e/0xfc956d548af42df1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612690.476760:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1788612690.477288:0:15066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:2.0:1788612690.477294:0:15066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1788612690.477310:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42ddc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.477323:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42ddc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.477331:0:15066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42ddc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.477338:0:15066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:2.0:1788612690.477343:0:15066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42ddc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.477352:0:15066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42ddc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.477372:0:15066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42ddc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.477378:0:15066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9a0f753/0xfc956d548af42ddc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612690.477457:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+19:2353:x1875495893463552:12345-192.168.202.6@tcp:4:dd.0 Request processed in 144429us (253867us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788612690.477479:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:2.0:1788612690.477508:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 6 00000100:00100000:2.0:1788612690.477517:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+18:2356:x1875495893464448:12345-192.168.202.6@tcp:4:dd.0 00010000:00010000:2.0:1788612690.477557:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eb02d2c/0xfc956d548af42df8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.477568:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612690.477572:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612690.477578:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eb02d2c/0xfc956d548af42df8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612690.477590:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eb02d2c/0xfc956d548af42df8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612690.521044:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:3.0:1788612690.521074:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:0.0:1788612690.521995:0:16605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:0.0:1788612690.522003:0:16605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:0.0:1788612690.522017:0:16605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000270bc78e/0xfc956d548af42df1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522030:0:16605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000270bc78e/0xfc956d548af42df1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522040:0:16605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000270bc78e/0xfc956d548af42df1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522060:0:16605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030200 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612690.522065:0:16605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000270bc78e/0xfc956d548af42df1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522076:0:16605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000270bc78e/0xfc956d548af42df1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522096:0:16605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000270bc78e/0xfc956d548af42df1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522104:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000270bc78e/0xfc956d548af42df1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612690.522207:0:16605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a69c66e5-135a-4565-b61a-424712bcbd1e+14:2355:x1875495893464320:12345-192.168.202.6@tcp:4:dd.0 Request processed in 91820us (100559us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788612690.522219:0:16605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5 00000100:00100000:0.0:1788612690.522250:0:16605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 7 00000100:00100000:0.0:1788612690.522263:0:16605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928ec0302d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a69c66e5-135a-4565-b61a-424712bcbd1e+13:2356:x1875495893464576:12345-192.168.202.6@tcp:4:dd.0 00010000:00010000:0.0:1788612690.522293:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eee8b28/0xfc956d548af42dff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522306:0:16605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612690.522310:0:16605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612690.522315:0:16605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002eee8b28/0xfc956d548af42dff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522340:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002eee8b28/0xfc956d548af42dff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522461:0:16604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055a4e916/0xfc956d548af42dea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522470:0:16604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055a4e916/0xfc956d548af42dea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522478:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055a4e916/0xfc956d548af42dea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522485:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928d8789ec00 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612690.522489:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055a4e916/0xfc956d548af42dea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522497:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055a4e916/0xfc956d548af42dea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522508:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055a4e916/0xfc956d548af42dea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522515:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055a4e916/0xfc956d548af42dea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612690.522560:0:16604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a69c66e5-135a-4565-b61a-424712bcbd1e+13:2355:x1875495893464192:12345-192.168.202.6@tcp:4:dd.0 Request processed in 98736us (100976us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788612690.522573:0:16604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00010000:00010000:0.0:1788612690.522607:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42de3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522617:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42de3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522625:0:15065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42de3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522631:0:15065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e80030400 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:0.0:1788612690.522635:0:15065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42de3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522643:0:15065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42de3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522655:0:15065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42de3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612690.522663:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094ae6915/0xfc956d548af42de3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612690.522697:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+11:2355:x1875495893464064:12345-192.168.202.6@tcp:4:dd.0 Request processed in 107655us (107914us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788612690.522704:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00000001:00080000:2.0:1788612690.569305:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:3.0:1788612690.569579:0:15066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1788612690.569596:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eb02d2c/0xfc956d548af42df8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.569610:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eb02d2c/0xfc956d548af42df8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.569630:0:15066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eb02d2c/0xfc956d548af42df8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.569637:0:15066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928ec21e9600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612690.569643:0:15066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eb02d2c/0xfc956d548af42df8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.569653:0:15066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eb02d2c/0xfc956d548af42df8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.569672:0:15066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eb02d2c/0xfc956d548af42df8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.569680:0:15066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eb02d2c/0xfc956d548af42df8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612690.569774:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a69c66e5-135a-4565-b61a-424712bcbd1e+9:2356:x1875495893464448:12345-192.168.202.6@tcp:4:dd.0 Request processed in 92253us (144579us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788612690.569784:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 6 00002000:00010000:3.0:1788612690.606886:0:16605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788612690.606911:0:16605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eee8b28/0xfc956d548af42dff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.606924:0:16605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002eee8b28/0xfc956d548af42dff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.606954:0:16605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002eee8b28/0xfc956d548af42dff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.606961:0:16605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff928e910d7600 already unused, calling callback (ffffffffc13f34f0) 00010000:00010000:3.0:1788612690.606966:0:16605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002eee8b28/0xfc956d548af42dff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.606975:0:16605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002eee8b28/0xfc956d548af42dff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.606995:0:16605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002eee8b28/0xfc956d548af42dff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612690.607004:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002eee8b28/0xfc956d548af42dff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612690.607100:0:16605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928ec0302d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a69c66e5-135a-4565-b61a-424712bcbd1e+7:2356:x1875495893464576:12345-192.168.202.6@tcp:4:dd.0 Request processed in 84837us (177997us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788612690.607110:0:16605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 7 00000001:00080000:1.0:1788612690.608166:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:2.0:1788612691.377482:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788612692.078827:0:16642:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788612692.396052:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612692.930704:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612692.930757:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612692.930790:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612692.930817:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612692.930834:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612692.930875:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612692.930903:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1788612692.930939:0:16599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893465216 00000100:00100000:0.0:1788612692.930950:0:16599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893465216 00000100:00100000:1.0:1788612692.930972:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893464704 00000100:00100000:1.0:1788612692.930979:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893464704 00000100:00100000:0.0:1788612692.931026:0:16599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893464832 00000100:00100000:0.0:1788612692.931031:0:16599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893464832 00000100:00100000:1.0:1788612692.931032:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:1.0:1788612692.931047:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928d84b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+13:2354:x1875495893464704:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612692.931064:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:0.0:1788612692.931074:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4888723e-f23f-4213-998f-bea11838d5b1+6:2354:x1875495893465216:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1788612692.931141:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928d84b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de248df6-b80e-4f4c-babe-3ba2189953f0+13:2354:x1875495893464704:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 97us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612692.931148:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:0.0:1788612692.931354:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4888723e-f23f-4213-998f-bea11838d5b1+6:2354:x1875495893465216:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 281us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612692.931363:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 30 00000100:00100000:0.0:1788612692.931380:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:0.0:1788612692.931388:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+20:2354:x1875495893464832:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1788612692.931420:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a69c66e5-135a-4565-b61a-424712bcbd1e+20:2354:x1875495893464832:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 33us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612692.931427:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 31 00000100:00100000:2.0:1788612692.931488:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893464960 00000100:00100000:2.0:1788612692.931495:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893464960 00000100:00100000:2.0:1788612692.931535:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893465472 00000100:00100000:2.0:1788612692.931539:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893465472 00000100:00100000:2.0:1788612692.931624:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893465088 00000100:00100000:2.0:1788612692.931628:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893465088 00000100:00100000:2.0:1788612692.931722:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495893465344 00000100:00100000:2.0:1788612692.931788:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495893465344 00000100:00100000:2.0:1788612692.931812:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:2.0:1788612692.931819:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2354:x1875495893464960:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612692.931892:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2354:x1875495893464960:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 74us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612692.931900:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:2.0:1788612692.931915:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:2.0:1788612692.931921:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4888723e-f23f-4213-998f-bea11838d5b1+5:2354:x1875495893465472:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612692.931944:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4888723e-f23f-4213-998f-bea11838d5b1+5:2354:x1875495893465472:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 23us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612692.931949:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:2.0:1788612692.931960:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:2.0:1788612692.931966:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2354:x1875495893465088:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612692.931987:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a69c66e5-135a-4565-b61a-424712bcbd1e+5:2354:x1875495893465088:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 22us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612692.931993:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 16 00000100:00100000:2.0:1788612692.932004:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00100000:2.0:1788612692.932010:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff928eadea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4888723e-f23f-4213-998f-bea11838d5b1+5:2354:x1875495893465344:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1788612692.932029:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff928eadea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4888723e-f23f-4213-998f-bea11838d5b1+5:2354:x1875495893465344:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 20us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612692.932035:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 17 00000100:00080000:2.0:1788612692.933930:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612692.933938:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612692.933942:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788612693.420059:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29292 lines, 29292 kept, 0 dropped, 0 bad.